-- Logs begin at Thu 2022-09-08 12:50:13 UTC, end at Thu 2022-09-08 14:22:12 UTC. -- Sep 08 13:50:31.370501 dv-cinder-847733-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 13:50:31.380723 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 13:50:31 2022] *** Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: nodename: dv-cinder-847733-4-iscsi Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: machine: x86_64 Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: clock source: unix Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: pcre jit disabled Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: detected number of CPU cores: 4 Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: current working directory: / Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: detected binary path: /usr/bin/uwsgi-core Sep 08 13:50:31.382031 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: your processes number limit is 47680 Sep 08 13:50:31.382732 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: your memory page size is 4096 bytes Sep 08 13:50:31.382732 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: detected max file descriptor number: 2048 Sep 08 13:50:31.382732 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: lock engine: pthread robust mutexes Sep 08 13:50:31.382732 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: thunder lock: enabled Sep 08 13:50:31.382732 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 13:50:31.382732 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 13:50:31.422269 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: Python main interpreter initialized at 0x55eecb03c9c0 Sep 08 13:50:31.422269 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: python threads support enabled Sep 08 13:50:31.422269 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: your server socket listen backlog is limited to 100 connections Sep 08 13:50:31.422269 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: your mercy for graceful operations on workers is 90 seconds Sep 08 13:50:31.422679 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 13:50:31.422679 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: *** Operational MODE: preforking *** Sep 08 13:50:31.422967 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: *** uWSGI is running in multiple interpreter mode *** Sep 08 13:50:31.422967 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: spawned uWSGI master process (pid: 117556) Sep 08 13:50:31.423182 dv-cinder-847733-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 13:50:31.426920 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: spawned uWSGI worker 1 (pid: 117557, cores: 1) Sep 08 13:50:31.426920 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: spawned uWSGI worker 2 (pid: 117558, cores: 1) Sep 08 13:50:31.426920 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 13:50:32.108722 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 13:50:32.114105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 13:50:33.231896 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:50:33.231896 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: from cryptography.utils import int_from_bytes Sep 08 13:50:33.232534 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:50:33.232534 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: from cryptography.utils import int_from_bytes Sep 08 13:50:33.232653 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:50:33.232653 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: from cryptography.utils import int_from_bytes Sep 08 13:50:33.233030 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:50:33.233030 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: from cryptography.utils import int_from_bytes Sep 08 13:50:35.785438 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:50:35.785968 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:50:35.786389 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:50:35.786752 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:50:35.787036 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:50:35.787425 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.787649 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:50:35.788034 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.788123 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:50:35.788215 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.788366 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.788453 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:50:35.788699 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.788792 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:50:35.789012 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.789104 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:50:35.789333 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.789425 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.789655 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.789752 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.789983 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.790075 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.790244 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.790341 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.790558 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.790660 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.790884 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-4-iscsi {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.790999 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.791241 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.791344 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.791544 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.791653 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.791857 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.791960 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.792172 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.792266 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.792479 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.792574 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.792831 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.792925 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-4-iscsi {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.793139 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.793276 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.802395 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.802681 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.802804 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.802965 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.803065 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.803135 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.803275 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.803368 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.803499 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.803589 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.803718 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.803822 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.803822 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.804020 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.804162 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.804254 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.804383 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.804477 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.804562 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.804642 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.804769 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.804852 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.804984 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-4-iscsi {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.805077 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.805207 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.805300 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.805300 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.805507 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.805596 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.805716 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.805807 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.805927 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806024 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806109 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806193 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-4-iscsi {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806314 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806407 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806502 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806571 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806696 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806792 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806878 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.806878 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.807100 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.807423 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.807558 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.807655 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.807742 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.807864 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.807946 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.808073 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.808167 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.808330 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.808462 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.808552 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.808685 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.808768 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.808897 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.808897 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.809096 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.809184 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.809306 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.809401 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.809401 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.809642 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.809772 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.809860 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.809987 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.809987 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.810189 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.810271 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.810271 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.810445 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.810535 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.810671 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.810757 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.810757 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.811029 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.811123 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.811254 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.811347 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.811347 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.811537 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.811619 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.811748 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.811839 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.811839 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.812055 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.812176 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.812263 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.812385 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.812385 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.812585 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.812688 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.812688 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.812886 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.812982 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.813070 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.813156 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.813156 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.813349 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.813437 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.813572 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.813655 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.813655 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.813852 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.813932 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.814052 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.814145 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.814145 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.814340 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.814472 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.814472 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.814703 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.814876 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.814876 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.815112 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.815209 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.815296 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.815377 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.815377 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.815573 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.815655 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.815655 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.815866 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.815955 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.816203 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.816300 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.816531 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.816682 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.816774 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.817078 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.817162 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.817405 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.817663 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.817765 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.818014 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.818123 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.818326 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.818511 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.818662 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.819010 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.819108 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.819325 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.819461 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.819638 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.819947 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.820041 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.820263 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.820404 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.820575 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.820873 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.820960 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.821183 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.822146 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.822259 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.822349 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.822429 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.822558 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.822647 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.822780 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.822870 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.822870 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.823033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.823154 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.823334 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.823429 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.823647 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.824383 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.824492 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.824810 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.824915 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.825196 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.825292 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.825447 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.825670 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.825766 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.826085 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.826182 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.826396 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.826612 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.826817 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.827153 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.827338 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.827447 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.827609 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.827775 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.828058 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.828211 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.828373 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.828516 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.828695 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.828944 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.829096 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.829323 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.829439 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.829632 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.829818 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.829941 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.830250 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.830345 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.830586 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.830721 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.830964 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.831197 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.831295 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.831519 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.831615 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.831923 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.832091 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.832271 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.832483 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.832572 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.832882 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.832982 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.833190 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.833402 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.833514 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.833834 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.833929 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.834194 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.834345 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.834542 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.834693 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.834855 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.835173 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.835327 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.835555 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.835720 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.835897 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.836069 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.836265 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.836499 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.836659 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.836943 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.837077 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.837300 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.837392 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.837618 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.837836 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.837924 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.838247 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.838334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.838572 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.838675 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.838945 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.839157 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.839259 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.839630 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.840238 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.840457 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.840569 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.840777 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.841001 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.841086 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.842679 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.842851 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.843043 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.843131 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.843256 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.843380 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.843467 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.843584 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.843670 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.843806 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.843806 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.843987 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.844070 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.844191 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.844273 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.844273 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.844563 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.844658 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.844781 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.844863 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.845006 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.845132 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:50:35.845325 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.845618 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.845726 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.845955 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.846065 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.846275 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.846548 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.846635 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.847731 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.847840 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.847955 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.848040 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.848150 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.848235 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.848358 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.848358 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.848558 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.848655 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.848776 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.848880 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.849145 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.849231 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.849469 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.849613 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.849787 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.850044 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.850139 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.850419 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.850539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.850738 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.851017 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.851155 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.851400 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.851526 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.851713 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.851938 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.852045 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.852321 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.852433 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.852632 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.852873 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.852983 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.853305 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.853398 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.853630 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.854109 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.854219 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.854350 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.854447 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.854645 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.854742 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.854994 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.855188 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.855347 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.855634 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.855719 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.855968 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.856150 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.856285 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.856596 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.856689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.856927 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.857076 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.857246 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.857583 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.857808 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.858496 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.858991 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.859249 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.859345 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.859472 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.859555 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.859678 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.859678 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.859876 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.859963 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.860084 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.860166 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.860287 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.860368 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.860553 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.860817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.860924 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.861183 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.861285 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.861526 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.861688 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.861864 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.862133 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.862230 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.862496 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.862593 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.862828 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.863074 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.863176 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.863478 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.863597 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.863794 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.863967 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.864107 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.864401 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.864493 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.864718 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.864838 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.865054 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.865301 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.865395 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.865661 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.865767 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.866022 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.866182 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.866276 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.866553 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.866656 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.866930 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.867115 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.867277 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.867522 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.867625 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.867808 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.868041 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.868128 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.868475 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.868567 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.868788 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.868969 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.869140 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.869408 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.869493 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.869794 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.869888 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.870130 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.870236 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.870472 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.870676 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.871337 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.871650 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.871757 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.871966 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.872112 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.872284 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.872559 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.872643 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.872910 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.873041 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.873261 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.873700 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.873847 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.873932 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.874070 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.874267 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.874374 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.874583 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.874813 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.874964 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.875326 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.875433 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.875672 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.875758 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.876023 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.876169 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.876366 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.876617 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.876710 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.877008 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.877103 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.877328 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.877487 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.877676 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.877920 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.878005 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.878299 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.878399 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.878617 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.878808 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.878970 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.879273 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.879358 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.879598 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.879685 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.879921 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.880127 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.880290 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.880563 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.880671 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.880924 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.881009 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.881247 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.881454 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.881541 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.881878 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.881972 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.882275 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.882361 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.882621 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.882718 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.882962 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.883222 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.883310 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.883601 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.883688 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.883917 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.884162 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.884248 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.884536 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.884629 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.884848 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.885009 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.885158 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.885455 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.885541 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.885781 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.885876 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.886095 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.886375 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.886475 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.887404 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.887553 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.887743 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.887879 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.888061 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.888310 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.888397 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.888672 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.888815 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.889132 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.889368 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.889835 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.889967 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.890060 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.891192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.891300 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.891434 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.893007 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.893110 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.893247 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.893247 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.894142 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.894252 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.894503 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.894640 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.894741 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.894833 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.894931 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.895002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.895137 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.895221 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.895363 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.895448 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.895574 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.895656 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.895778 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.895860 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.895860 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.896065 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.896187 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.896277 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.896464 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.896464 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.896735 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.896886 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897010 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897101 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897101 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897314 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897406 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897406 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897659 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897761 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897876 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897996 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.897996 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.898193 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.898275 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.898399 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.898481 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.898481 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.898686 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.898803 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.898978 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.899063 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.899253 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.899356 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.899571 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.899802 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.899955 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.900234 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.900509 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.900651 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.900850 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.901079 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.901164 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.901487 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.901585 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.901839 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.901937 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.902197 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.902391 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.902547 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.902857 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.903035 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.903213 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.903377 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.903533 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.903833 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.903928 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.904147 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.904299 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.904519 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.904766 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.904958 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.905229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.905338 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.905543 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.905696 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.905859 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.906148 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.906233 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.906475 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.906588 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.906786 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.907068 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.907175 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.907432 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.907573 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.907738 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.907978 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.908065 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.908350 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.908447 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.908661 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.908856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.908975 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.909295 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.909379 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.909607 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.909739 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.909916 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.910184 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.910270 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.910589 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.910742 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.910950 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.911336 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.911554 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.911828 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.911931 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.912253 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.912338 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.912575 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.912713 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.912969 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.913223 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.913316 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.913608 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.913727 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.913915 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.914175 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.914271 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.914527 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.914680 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.914840 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.915144 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.915231 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.915477 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.915564 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.915793 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.915992 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.916135 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.916424 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.916509 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.916773 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.916892 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.917082 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.917331 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.917431 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.917726 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.917830 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.918149 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.918319 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.918470 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.918653 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.918760 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.919071 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.919261 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.919417 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.919684 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.919851 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.919989 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.920367 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.920514 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.920663 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.920806 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.920980 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.921291 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.921436 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.921631 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.921923 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.922090 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.922240 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.922453 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.922538 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.922865 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.923056 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.923208 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.923413 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.923540 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.923835 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.923945 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.924154 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.924403 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.924502 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.924754 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.924885 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.925067 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.925318 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.925404 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.925705 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.925800 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.926016 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.926151 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.926331 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.926624 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.926719 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.926971 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.927141 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.927391 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.927578 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.927713 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.928024 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.928109 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.928334 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.928500 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.928644 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.928933 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.929018 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.929275 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.929377 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.929608 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.929800 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.929921 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.930232 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.930330 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.930539 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.930695 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.930849 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.931161 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.931248 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.931523 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.931610 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.931894 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.931984 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.932208 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.932467 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.932559 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.932839 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.932934 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.933156 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.933795 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.933988 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.934274 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.934369 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.934603 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.934689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.934944 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.935191 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.935276 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.935568 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.935694 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.935940 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.936066 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.936373 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.936480 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.936840 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.936935 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.937326 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.937557 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.937666 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.938023 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.938117 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.938360 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.938455 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.938695 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.938884 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.939041 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.939342 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.939428 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.939672 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.939861 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.940021 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.940294 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.940457 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.940735 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.940942 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.941053 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.941260 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.941444 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.941577 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.941875 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.941960 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.942196 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.942308 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.942509 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.942765 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.942851 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.943153 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.943240 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.943466 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.943638 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.943798 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.944112 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.944196 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.944449 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.944545 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.944767 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.944965 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.945098 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.945380 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.945473 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.945691 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.945835 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.946131 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.946305 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.946497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.946693 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.946790 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.947112 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.947202 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.947429 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.947570 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.947744 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.948002 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.948102 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.948371 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.948458 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.948680 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.948964 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.949650 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.949895 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.949993 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.950307 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.950410 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.950713 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.950914 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.951165 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.951254 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.951480 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.951674 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.951797 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.952131 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.952217 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.952441 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.954708 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.954828 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.954966 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.955065 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.955202 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.955292 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.955754 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.957942 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958052 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958189 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958282 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958365 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958453 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958534 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958622 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958702 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958780 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958857 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.958969 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.959101 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.959199 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.959280 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.959370 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.959450 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.959528 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.959605 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.959695 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.959695 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.959916 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960127 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960209 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960341 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960432 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960524 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960611 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960690 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960777 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960856 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.960934 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961011 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961089 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961167 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961253 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961332 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961463 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961561 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961687 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961773 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961861 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.961941 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.962019 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.962086 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.962162 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.962240 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.962330 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.962410 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.962524 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.962714 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.962859 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.962859 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.963164 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.963271 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.963370 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.963507 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.963605 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.963605 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.963762 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.963840 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.963925 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.964078 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.964078 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.964277 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.964382 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.964548 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.964684 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.964867 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.965003 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.965181 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.965311 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.965497 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.965628 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.965914 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.966022 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.966244 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.966338 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.966574 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.966698 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.966884 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.967050 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.967239 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.967378 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.967563 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.967712 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.967904 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.968055 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.968188 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.968320 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.968500 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.968646 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.968829 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.968982 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.969143 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.969280 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.969453 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.969600 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.969749 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.969880 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.970130 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.970277 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.970408 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.970537 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.970706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.970848 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.971059 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.971196 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.971391 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.971531 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.971703 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.971844 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.972017 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.972153 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.972326 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.972461 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.972706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.972839 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.973039 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.973177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.973401 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.973550 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.973711 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.973847 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.974032 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.974170 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.974341 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.974560 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.974696 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.974837 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.974998 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.975130 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.975290 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.975501 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.975641 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.975773 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.975937 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.976105 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.976242 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.976376 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.976506 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.976648 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.976780 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.976915 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.977087 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.977234 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.977412 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.977565 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.977699 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.977829 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.978037 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.978179 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.978332 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.978464 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.978673 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.978812 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.979022 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.979162 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.979314 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.979449 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.979630 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.979771 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.979944 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.980081 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.980294 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.980409 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.980609 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.980704 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.980921 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.981023 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.981236 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.981329 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.981550 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.981642 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.981864 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.981965 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.982179 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.982271 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.982493 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.982593 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.982809 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.983132 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.983229 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.983320 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.983441 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.983536 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.983748 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.983849 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.984111 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.984197 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.984515 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.984766 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.984924 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.985049 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.985262 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.985384 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.985575 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.985705 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.985892 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.986025 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.986201 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.986382 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.986647 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.986773 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.986996 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.987151 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.987307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.987407 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.987621 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.987705 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.987937 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.988014 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.988247 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.988321 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.988568 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.988644 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.988888 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.988965 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.989231 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.989334 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.989587 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.989765 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.989913 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.990091 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.990235 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.990451 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.990540 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.990719 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.990870 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.991055 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.991259 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.991348 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.991581 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.991657 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.991894 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.991970 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.992216 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.992298 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.992538 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.992628 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.992859 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.992943 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.993179 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.993255 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.993485 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.993561 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.993804 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.993878 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.994131 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.994265 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.994446 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.994570 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.994766 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.994933 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.995113 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.995252 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.995437 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.995576 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.996307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.996452 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.996741 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.996897 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.997071 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.997193 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.997397 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.997538 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.997711 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.997859 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.998032 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.998180 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.998436 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.998579 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.998771 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.998954 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.999127 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.999316 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.999456 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.999657 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.999813 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:35.999995 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.000134 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.000323 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.000475 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.000696 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.000844 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.000982 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.001116 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.001258 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.001388 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.001579 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.001798 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.002021 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.002162 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.002347 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.002548 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.002741 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.002919 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.003011 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.003094 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.003317 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.003454 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.003618 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.003713 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.003930 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.004017 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.004242 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.004328 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.004551 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.004785 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.004878 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.005142 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.005236 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.005467 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.005562 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.005778 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.005864 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.006089 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.006174 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.006397 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.006484 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.006704 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.006790 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.007053 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.007145 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.007363 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.007459 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.007697 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.007846 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.008015 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.008151 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.008341 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.008476 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.008661 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.008796 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.008966 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.009091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.009287 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.009454 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.009605 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.009754 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.009892 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.010035 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.010190 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.010317 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.010501 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.010632 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.010854 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.011092 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.011225 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.011351 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.012154 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.012288 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.012431 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.012567 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.012710 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.012849 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.012994 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.013124 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.013376 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.013601 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.013749 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.013895 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.014029 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.014170 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.014405 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.014546 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.014685 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.014816 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.015002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.015116 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.015303 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.015435 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.015630 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.015774 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.015998 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.016242 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.016408 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.016616 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.016753 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.016953 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.017279 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.017436 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.017586 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.017802 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.017939 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.018215 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.018363 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.018549 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.018691 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.018868 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.019031 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.019218 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.019359 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.019577 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.019732 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.019876 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.020018 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.020205 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.020478 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.020631 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.020823 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.020976 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.021111 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.021252 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.021426 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.021579 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.021812 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.021950 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.022127 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.022265 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.022442 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.022582 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.022754 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.022956 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.023117 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.023279 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.023426 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.023557 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.023745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.023895 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.024060 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.024195 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.024357 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.024499 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.024674 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.024823 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.024994 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.025141 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.025312 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.025449 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.025632 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.025772 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.025945 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.026092 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.026242 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.026375 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.026566 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.026711 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.026878 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.027179 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.027323 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.027513 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.027652 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.027834 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.027973 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.028158 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.028300 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.028474 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.028570 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.028792 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.028883 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.029110 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.029195 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.029429 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.029515 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.029933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.030048 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.030132 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.030211 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.030382 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.030797 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.031054 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.031287 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.031412 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.031509 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.031813 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.031915 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.032102 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.032191 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.032417 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.032502 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.032764 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.033040 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.033137 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.033360 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.033446 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.033728 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.033824 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.034049 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.034135 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.034362 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.034449 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.034682 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.034768 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.035034 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.035124 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.035356 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.035486 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.035675 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.035762 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.036017 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.036380 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.036580 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.036679 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.036893 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.036989 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.037207 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.037299 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.037520 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.037606 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.037836 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.037936 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.038162 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.038256 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.038484 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.038577 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.038805 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.038932 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.039156 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.039241 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.039472 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.039555 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.039785 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.039885 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.040099 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.040184 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.040414 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.040626 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.040724 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.040947 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.041034 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.041290 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.041375 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.041619 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.041712 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.041934 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.042020 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.042244 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.042329 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.042553 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.042668 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.042906 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.042994 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.043221 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.043322 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.043557 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.043648 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.043864 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.043960 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.044175 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.044258 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.044484 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.044569 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.044795 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.044887 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.045106 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.045192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.045411 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.045555 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.045716 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.046033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.046118 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.046380 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.046568 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.046702 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.047069 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.047533 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.047678 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.047795 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.047916 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.048059 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.048193 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.048324 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.048468 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.048603 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.048738 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.048854 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.049044 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.049180 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.049327 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.049457 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.049588 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.049720 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.049865 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.050005 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.050155 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.050298 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.050435 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.050566 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.050735 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.050928 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.051081 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.051201 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.051378 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.051530 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.051683 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.051848 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.051983 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.052179 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.052321 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.052492 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.052633 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.052822 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.052967 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.053232 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.053496 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.053496 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.053837 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.054028 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.054170 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.054297 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.054438 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.054590 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.054742 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.054884 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.055054 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.055208 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.055348 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.055497 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.055719 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.055863 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.056013 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.056155 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.056364 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.056509 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.056662 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.056813 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.056952 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.057090 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.057229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.057379 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.057529 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.057668 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.057810 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.057961 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.058101 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.058769 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.058959 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.059102 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.059240 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.059394 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.059533 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.059685 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.059826 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.059963 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.060101 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.060237 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.060373 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.060534 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.060684 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.060931 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.061077 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.061257 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.061406 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.061627 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.061780 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.061920 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.062126 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.062280 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:50:36.062438 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.062771 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.063244 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.063577 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.063889 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.064197 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.064528 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.064842 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.065160 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.065476 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.065790 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.066104 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.066418 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.066730 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.067073 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.067386 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.067707 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.068018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.068335 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.068645 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.068959 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.069276 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.069626 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.069941 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.070268 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.070584 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.070925 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.071258 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.071577 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.071893 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.072212 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.072530 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.072866 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.073184 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.073495 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.075440 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.075440 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.075696 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.075841 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.076119 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.076450 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.076782 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.077103 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.077432 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.077757 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.078095 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.078444 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.078788 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.079145 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.079459 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.079768 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.080072 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.080387 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.080717 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.081025 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.081341 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.081698 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.082057 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.082362 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.082736 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.082999 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.083310 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.083624 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.083931 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.084239 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.084547 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.084861 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.085161 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.085467 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.085788 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.086088 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.086396 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.086703 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.087043 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.087352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.087702 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.088045 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.088369 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.088700 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.089014 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.089344 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.090200 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.090532 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.090857 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.091211 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.091525 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.091925 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.092186 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.092503 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.092820 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.094808 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.094808 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.094808 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.094808 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.094808 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.094808 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.095828 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.095828 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.095828 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.096059 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.097234 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.097234 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.097234 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.097475 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.097605 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.097919 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.098240 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.098561 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.098875 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.099215 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.099536 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.099855 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.100199 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.100542 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.100859 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.101187 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.101521 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.101881 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.102195 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.102547 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.102884 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.103230 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.103547 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.103858 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:50:36.104112 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:50:36.219279 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO dbcounter [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Registered counter for database nova_api Sep 08 13:50:36.240383 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:50:36.247138 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writer thread running {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:50:36.258106 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO dbcounter [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Registered counter for database nova_api Sep 08 13:50:36.280618 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG oslo_db.sqlalchemy.engines [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:50:36.294385 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writer thread running {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:50:36.307616 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.context [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43ffdb1b-6a17-4540-82fa-c15e3a06dc21(cell1) {{(pid=117557) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 13:50:36.311911 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:36.312497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:36.313991 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:36.314718 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:36.315200 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:36.317278 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:36.319312 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO dbcounter [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Registered counter for database nova_cell0 Sep 08 13:50:36.323713 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO dbcounter [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Registered counter for database nova_cell1 Sep 08 13:50:36.332560 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:50:36.335482 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:50:36.340149 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writer thread running {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:50:36.343965 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writer thread running {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:50:36.390205 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.context [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43ffdb1b-6a17-4540-82fa-c15e3a06dc21(cell1) {{(pid=117558) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 13:50:36.394384 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG oslo_concurrency.lockutils [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:36.394866 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG oslo_concurrency.lockutils [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:36.396491 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG oslo_concurrency.lockutils [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:36.397218 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG oslo_concurrency.lockutils [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:36.397668 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG oslo_concurrency.lockutils [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:36.399787 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG oslo_concurrency.lockutils [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:36.401806 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO dbcounter [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Registered counter for database nova_cell0 Sep 08 13:50:36.406007 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO dbcounter [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Registered counter for database nova_cell1 Sep 08 13:50:36.414120 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG oslo_db.sqlalchemy.engines [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:50:36.416519 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG oslo_db.sqlalchemy.engines [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:50:36.421652 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writer thread running {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:50:36.493759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO dbcounter [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Registered counter for database nova_cell0 Sep 08 13:50:36.501363 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:50:36.507164 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writer thread running {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:50:36.561320 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writer thread running {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:50:36.571264 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO dbcounter [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Registered counter for database nova_cell0 Sep 08 13:50:36.578427 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG oslo_db.sqlalchemy.engines [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:50:36.582749 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writer thread running {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:50:36.963934 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: WARNING keystonemiddleware.auth_token [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:50:36.971270 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: WARNING keystonemiddleware.auth_token [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:50:37.114922 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: WARNING keystonemiddleware.auth_token [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:50:37.122799 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: WARNING keystonemiddleware.auth_token [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:50:37.313495 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: WARNING keystonemiddleware.auth_token [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:50:37.319708 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: WARNING keystonemiddleware.auth_token [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:50:37.326459 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eecb03c9c0 pid: 117557 (default app) Sep 08 13:50:37.328769 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:37.329975 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] 10.222.0.91 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001907 Sep 08 13:50:37.330759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 1/1] 10.222.0.91 () {50 vars in 788 bytes} [Thu Sep 8 13:50:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:37.471562 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: WARNING keystonemiddleware.auth_token [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:50:37.480073 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: WARNING keystonemiddleware.auth_token [None req-36ff01d7-7b32-4af4-8b2f-34124e1635ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:50:37.483704 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eecb03c9c0 pid: 117558 (default app) Sep 08 13:52:12.340874 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:12.341859 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 Sep 08 13:52:12.342259 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 2/2] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:12.354853 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writing DB stats nova_api:SELECT=3 {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:12.355864 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writing DB stats nova_cell0:SELECT=3 {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:12.356915 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writing DB stats nova_cell1:SELECT=3 {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:12.358935 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:13.290227 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-d991518a-39bf-4641-88eb-278b12a6a8ba admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:13.322715 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-d991518a-39bf-4641-88eb-278b12a6a8ba admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.973266 Sep 08 13:52:13.323781 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 1/3] 10.222.0.91 () {60 vars in 1292 bytes} [Thu Sep 8 13:52:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:16.125131 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:16.126613 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-8aa45bfc-a83c-4cd9-aa59-bbff37a3acc6 None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001860 Sep 08 13:52:16.127440 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 3/4] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:16.703564 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-784650d6-aed1-4caf-b97f-5520fa22f699 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:16.815550 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-784650d6-aed1-4caf-b97f-5520fa22f699 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.681013 Sep 08 13:52:16.816206 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 2/5] 10.222.0.91 () {64 vars in 1283 bytes} [Thu Sep 8 13:52:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:52:16.831105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_api:SELECT=3 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:16.831924 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_cell0:SELECT=3 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:16.834811 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_cell1:SELECT=3 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:16.835627 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:17.047854 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-771cc419-0126-4165-9c99-26c05a0988a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:17.200642 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-771cc419-0126-4165-9c99-26c05a0988a6 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.375122 Sep 08 13:52:17.201283 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 4/6] 10.222.0.91 () {64 vars in 1336 bytes} [Thu Sep 8 13:52:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:20.081458 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-784650d6-aed1-4caf-b97f-5520fa22f699 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:20.083514 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-784650d6-aed1-4caf-b97f-5520fa22f699 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002236 Sep 08 13:52:20.085545 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 3/7] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:21.001294 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-0e40dd29-52c2-43ae-8930-05b5629a55e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:21.142381 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-0e40dd29-52c2-43ae-8930-05b5629a55e9 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.043253 Sep 08 13:52:21.143162 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 5/8] 10.222.0.91 () {64 vars in 1283 bytes} [Thu Sep 8 13:52:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:52:21.155643 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-efe04d00-d9b5-495a-9866-b108128cbb09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:21.279545 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-efe04d00-d9b5-495a-9866-b108128cbb09 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127628 Sep 08 13:52:21.280402 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 4/9] 10.222.0.91 () {64 vars in 1336 bytes} [Thu Sep 8 13:52:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:24.587329 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-0e40dd29-52c2-43ae-8930-05b5629a55e9 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:24.588441 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-0e40dd29-52c2-43ae-8930-05b5629a55e9 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001934 Sep 08 13:52:24.588929 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 6/10] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:25.095802 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-421fa89a-7bb5-4b76-932c-651fc8c1803c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "id": "d2", "name": "ds1G", "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:25.181329 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-421fa89a-7bb5-4b76-932c-651fc8c1803c admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.584635 Sep 08 13:52:25.182282 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 5/11] 10.222.0.91 () {64 vars in 1283 bytes} [Thu Sep 8 13:52:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:52:25.197683 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-a9f8086c-2112-4e63-8255-f101b6d46973 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:25.299352 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-a9f8086c-2112-4e63-8255-f101b6d46973 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106200 Sep 08 13:52:25.299969 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 7/12] 10.222.0.91 () {64 vars in 1336 bytes} [Thu Sep 8 13:52:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:28.269980 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-421fa89a-7bb5-4b76-932c-651fc8c1803c admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:28.271049 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-421fa89a-7bb5-4b76-932c-651fc8c1803c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 08 13:52:28.272016 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 6/13] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:28.916679 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-640fbc03-d46a-4281-8f8b-f771dcad4526 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:29.018452 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-640fbc03-d46a-4281-8f8b-f771dcad4526 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.738333 Sep 08 13:52:29.027645 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 8/14] 10.222.0.91 () {64 vars in 1283 bytes} [Thu Sep 8 13:52:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:52:29.032665 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-e2359aa4-8ddb-4dfe-a777-c260b2e6b52a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:29.151183 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-e2359aa4-8ddb-4dfe-a777-c260b2e6b52a admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122437 Sep 08 13:52:29.155629 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 7/15] 10.222.0.91 () {64 vars in 1336 bytes} [Thu Sep 8 13:52:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:31.978853 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-640fbc03-d46a-4281-8f8b-f771dcad4526 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:31.980654 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-640fbc03-d46a-4281-8f8b-f771dcad4526 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002267 Sep 08 13:52:31.981326 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 9/16] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:32.476423 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-8009982c-0697-422b-9b01-658f2b692048 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "id": "d4", "vcpus": 4}} {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:32.548306 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-8009982c-0697-422b-9b01-658f2b692048 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.559349 Sep 08 13:52:32.549007 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 8/17] 10.222.0.91 () {64 vars in 1283 bytes} [Thu Sep 8 13:52:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:52:32.563643 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-10e8fd12-ebce-46f9-a0c7-df49f2e66c68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:32.657250 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-10e8fd12-ebce-46f9-a0c7-df49f2e66c68 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097139 Sep 08 13:52:32.658090 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 10/18] 10.222.0.91 () {64 vars in 1336 bytes} [Thu Sep 8 13:52:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:52:36.108189 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-8009982c-0697-422b-9b01-658f2b692048 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:36.109256 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-8009982c-0697-422b-9b01-658f2b692048 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Sep 08 13:52:36.109988 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 9/19] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:36.605304 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-467a0d7e-3f81-4259-8914-dadac51bfe51 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:36.646074 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-467a0d7e-3f81-4259-8914-dadac51bfe51 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.526925 Sep 08 13:52:36.646724 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 11/20] 10.222.0.91 () {60 vars in 1292 bytes} [Thu Sep 8 13:52:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:52:39.318164 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-8009982c-0697-422b-9b01-658f2b692048 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:39.319202 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-8009982c-0697-422b-9b01-658f2b692048 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Sep 08 13:52:39.319606 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 10/21] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:52:39.752040 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-f8e0250b-7aaf-4ac0-a1e0-745f3b662bbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "vcpus": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:39.838937 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-f8e0250b-7aaf-4ac0-a1e0-745f3b662bbf admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.512240 Sep 08 13:52:39.839307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 12/22] 10.222.0.91 () {64 vars in 1283 bytes} [Thu Sep 8 13:52:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:52:39.853184 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-d3a60025-5835-47dd-b414-232a6f0a89e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:39.958800 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-d3a60025-5835-47dd-b414-232a6f0a89e4 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110927 Sep 08 13:52:39.959425 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 11/23] 10.222.0.91 () {64 vars in 1333 bytes} [Thu Sep 8 13:52:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:42.669181 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-f8e0250b-7aaf-4ac0-a1e0-745f3b662bbf admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:42.670163 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-f8e0250b-7aaf-4ac0-a1e0-745f3b662bbf admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 08 13:52:42.675243 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 13/24] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:43.238082 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-8967405c-a8d2-4ba6-930f-ee45dc0e2bda admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "vcpus": 1, "disk": 20, "id": "2", "os-flavor-access:is_public": true}} {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:43.244238 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:43.345176 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-8967405c-a8d2-4ba6-930f-ee45dc0e2bda admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.668516 Sep 08 13:52:43.346016 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 12/25] 10.222.0.91 () {64 vars in 1283 bytes} [Thu Sep 8 13:52:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:52:43.358525 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-94297065-cb0a-40c4-8c41-e666abe269a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:43.445520 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-94297065-cb0a-40c4-8c41-e666abe269a8 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090761 Sep 08 13:52:43.446108 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 14/26] 10.222.0.91 () {64 vars in 1333 bytes} [Thu Sep 8 13:52:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:52:46.246424 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-8967405c-a8d2-4ba6-930f-ee45dc0e2bda admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:46.247479 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-8967405c-a8d2-4ba6-930f-ee45dc0e2bda admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 08 13:52:46.248115 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 13/27] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:46.839193 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-bb35c6da-d3e8-4275-858f-788550c190e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:46.928608 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-bb35c6da-d3e8-4275-858f-788550c190e0 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.672961 Sep 08 13:52:46.929598 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 15/28] 10.222.0.91 () {64 vars in 1283 bytes} [Thu Sep 8 13:52:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:52:46.941913 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-10cdd8e1-a5ce-4e3d-9ec3-34eca0335607 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:47.060399 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-10cdd8e1-a5ce-4e3d-9ec3-34eca0335607 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122186 Sep 08 13:52:47.060953 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 14/29] 10.222.0.91 () {64 vars in 1333 bytes} [Thu Sep 8 13:52:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:49.857274 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-bb35c6da-d3e8-4275-858f-788550c190e0 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:49.858432 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-bb35c6da-d3e8-4275-858f-788550c190e0 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 08 13:52:49.859405 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 16/30] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:50.472097 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-77afb0d0-917d-4cc4-9caa-7a15de52f5d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "vcpus": 4, "id": "4", "disk": 80}} {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:50.793634 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-77afb0d0-917d-4cc4-9caa-7a15de52f5d9 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.926244 Sep 08 13:52:50.794953 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 15/31] 10.222.0.91 () {64 vars in 1283 bytes} [Thu Sep 8 13:52:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:52:50.806675 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-d1ff5c06-15c2-40e6-a154-e9e16b3d7d04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:50.812572 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:50.905989 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-d1ff5c06-15c2-40e6-a154-e9e16b3d7d04 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102952 Sep 08 13:52:50.907594 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 17/32] 10.222.0.91 () {64 vars in 1333 bytes} [Thu Sep 8 13:52:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:53.682571 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-77afb0d0-917d-4cc4-9caa-7a15de52f5d9 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:53.683653 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-77afb0d0-917d-4cc4-9caa-7a15de52f5d9 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 08 13:52:53.684309 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 16/33] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:52:54.229551 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-0daf91f2-e1a4-48a4-9291-106c03edfa54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "vcpus": 8}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:54.305121 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-0daf91f2-e1a4-48a4-9291-106c03edfa54 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.614710 Sep 08 13:52:54.305759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 18/34] 10.222.0.91 () {64 vars in 1283 bytes} [Thu Sep 8 13:52:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:52:54.319289 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-07dd8e7b-0d91-4b9d-941e-0c3623b14a94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:54.415354 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-07dd8e7b-0d91-4b9d-941e-0c3623b14a94 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100478 Sep 08 13:52:54.415942 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 17/35] 10.222.0.91 () {64 vars in 1333 bytes} [Thu Sep 8 13:52:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:10.260167 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-0daf91f2-e1a4-48a4-9291-106c03edfa54 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:10.261171 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-0daf91f2-e1a4-48a4-9291-106c03edfa54 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 08 13:53:10.261576 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 19/36] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:53:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:10.273044 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:10.685662 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-1cf22263-1261-4b21-b392-cec4cebc6716 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:10.704825 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-1cf22263-1261-4b21-b392-cec4cebc6716 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.436904 Sep 08 13:53:10.705367 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 18/37] 10.222.0.91 () {60 vars in 1292 bytes} [Thu Sep 8 13:53:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:53:12.018268 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-0daf91f2-e1a4-48a4-9291-106c03edfa54 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:12.019302 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-0daf91f2-e1a4-48a4-9291-106c03edfa54 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 08 13:53:12.019733 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 20/38] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:53:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:12.705166 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-adbfa9c0-b8ad-462a-aaf4-e2cdd382175e admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:12.711096 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.wsgi [None req-adbfa9c0-b8ad-462a-aaf4-e2cdd382175e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-adbfa9c0-b8ad-462a-aaf4-e2cdd382175e admin admin] Request method failure captured: Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Accept: application/json Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Accept-Encoding: gzip, deflate Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Connection: keep-alive Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Content-Length: 0 Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Host: 10.222.0.91 Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Openstack-Api-Version: compute 2.92 Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Openstack-System-Scope: None Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: User-Agent: python-novaclient Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Auth-Token: gAAAAABjGfPHLhf-Pa0T1jOyWww579eblXFgSi4h1pe75aTa-JVrRARcuX5tx54inEnn3rb83n_0KynNlnYpBvv5dzaqt7EKEFIFzq0uYQoTYJ-8JKwcoGCjnKmYuDKCcvyoSQHYP18FTGW-5druYz2ZG8zKjdxpfYuZs9f6T_23fo-U3b_R86g Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Domain-Id: None Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Domain-Name: None Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Identity-Status: Confirmed Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Is-Admin-Project: True Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Domain-Id: default Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Domain-Name: Default Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Name: admin Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Role: member,admin,reader Sep 08 13:53:12.714334 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Roles: member,admin,reader Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/189571d729d54bff900838adb0030c5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_189571d729d54bff900838adb0030c5b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Tenant: admin Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Tenant-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Tenant-Name: admin Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User: admin Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Domain-Id: default Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Domain-Name: Default Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Id: c14eb0bf645e49f887a8d288d37d1491 Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Name: admin Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: method: > Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: exception: Flavor 42 could not be found. Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: action_args: {'id': '42'} Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:53:12.716018 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:12.717077 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:12.718267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-adbfa9c0-b8ad-462a-aaf4-e2cdd382175e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:53:12.719383 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-adbfa9c0-b8ad-462a-aaf4-e2cdd382175e admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.558818 Sep 08 13:53:12.719383 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 19/39] 10.222.0.91 () {60 vars in 1190 bytes} [Thu Sep 8 13:53:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 560 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:12.725586 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-86928982-67d0-45bb-95e1-38236a302edf admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:12.730659 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:12.750729 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-86928982-67d0-45bb-95e1-38236a302edf admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026961 Sep 08 13:53:12.750729 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 21/40] 10.222.0.91 () {60 vars in 1210 bytes} [Thu Sep 8 13:53:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:53:12.760267 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-874111e9-2d50-40fc-95c6-2fbc1359b5ff admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:12.783284 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-874111e9-2d50-40fc-95c6-2fbc1359b5ff admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027511 Sep 08 13:53:12.783850 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 20/41] 10.222.0.91 () {60 vars in 1210 bytes} [Thu Sep 8 13:53:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:53:12.793910 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-4b7ec8cb-620d-4734-8955-960bb4856076 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:12.799677 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.wsgi [None req-4b7ec8cb-620d-4734-8955-960bb4856076 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-4b7ec8cb-620d-4734-8955-960bb4856076 admin admin] Request method failure captured: Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Accept: application/json Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Accept-Encoding: gzip, deflate Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Connection: keep-alive Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Content-Length: 0 Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Host: 10.222.0.91 Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Openstack-Api-Version: compute 2.92 Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Openstack-System-Scope: None Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: User-Agent: python-novaclient Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Auth-Token: gAAAAABjGfPHLhf-Pa0T1jOyWww579eblXFgSi4h1pe75aTa-JVrRARcuX5tx54inEnn3rb83n_0KynNlnYpBvv5dzaqt7EKEFIFzq0uYQoTYJ-8JKwcoGCjnKmYuDKCcvyoSQHYP18FTGW-5druYz2ZG8zKjdxpfYuZs9f6T_23fo-U3b_R86g Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Domain-Id: None Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Domain-Name: None Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Identity-Status: Confirmed Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Is-Admin-Project: True Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Domain-Id: default Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Domain-Name: Default Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Name: admin Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Role: member,admin,reader Sep 08 13:53:12.802938 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Roles: member,admin,reader Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/189571d729d54bff900838adb0030c5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_189571d729d54bff900838adb0030c5b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Tenant: admin Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Tenant-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Tenant-Name: admin Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User: admin Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Domain-Id: default Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Domain-Name: Default Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Id: c14eb0bf645e49f887a8d288d37d1491 Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Name: admin Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: method: > Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: exception: Flavor 42 could not be found. Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: action_args: {'id': '42'} Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:53:12.804307 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:12.805105 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:12.806177 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-4b7ec8cb-620d-4734-8955-960bb4856076 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:53:12.807353 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-4b7ec8cb-620d-4734-8955-960bb4856076 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014098 Sep 08 13:53:12.807353 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 22/42] 10.222.0.91 () {60 vars in 1190 bytes} [Thu Sep 8 13:53:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 08 13:53:14.058424 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-874111e9-2d50-40fc-95c6-2fbc1359b5ff admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:14.059472 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-874111e9-2d50-40fc-95c6-2fbc1359b5ff admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 08 13:53:14.059869 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 21/43] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:14.587811 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-ab7300f3-99c1-468d-a2a9-b46dfad0dd9f admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:14.592730 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.wsgi [None req-ab7300f3-99c1-468d-a2a9-b46dfad0dd9f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-ab7300f3-99c1-468d-a2a9-b46dfad0dd9f admin admin] Request method failure captured: Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Accept: application/json Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Accept-Encoding: gzip, deflate Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Connection: keep-alive Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Content-Length: 0 Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Host: 10.222.0.91 Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Openstack-Api-Version: compute 2.92 Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Openstack-System-Scope: None Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: User-Agent: python-novaclient Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Auth-Token: gAAAAABjGfPJqSR64rP9up6lHgJ1Wu_Zj5bawH0daOo2PeFEHfAfYjFjl0BlfB947XAzgHfJgBFLiXHGgPPKsitTb_9jTYGTpg5_jel3Qgj78w4qEtZLnNu4hozMEH16Cq1Z7F6Ja4ilq-cRF9jew4Pn58vRjwNfIl7agYjypvg17lEJKVjJESE Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Domain-Id: None Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Domain-Name: None Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Identity-Status: Confirmed Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Is-Admin-Project: True Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Domain-Id: default Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Domain-Name: Default Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Name: admin Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Role: member,admin,reader Sep 08 13:53:14.594229 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Roles: member,admin,reader Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/189571d729d54bff900838adb0030c5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_189571d729d54bff900838adb0030c5b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Tenant: admin Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Tenant-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Tenant-Name: admin Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User: admin Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Domain-Id: default Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Domain-Name: Default Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Id: c14eb0bf645e49f887a8d288d37d1491 Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Name: admin Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: method: > Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: exception: Flavor 84 could not be found. Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: action_args: {'id': '84'} Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:53:14.595759 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:14.596706 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:14.598091 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-ab7300f3-99c1-468d-a2a9-b46dfad0dd9f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:53:14.599330 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-ab7300f3-99c1-468d-a2a9-b46dfad0dd9f admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.397075 Sep 08 13:53:14.599330 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 23/44] 10.222.0.91 () {60 vars in 1190 bytes} [Thu Sep 8 13:53:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:14.605359 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-fb0c8bd0-6ca5-44fe-88f2-19003fd95127 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:14.620324 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-fb0c8bd0-6ca5-44fe-88f2-19003fd95127 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018432 Sep 08 13:53:14.620890 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 22/45] 10.222.0.91 () {60 vars in 1210 bytes} [Thu Sep 8 13:53:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:53:14.631739 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-ba2fd380-91fe-4a15-ac45-07b51c50302f admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:14.649891 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-ba2fd380-91fe-4a15-ac45-07b51c50302f admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022882 Sep 08 13:53:14.650439 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 24/46] 10.222.0.91 () {60 vars in 1210 bytes} [Thu Sep 8 13:53:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:53:14.660153 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-ac2b15a7-a1c6-4d9d-8e45-8860160936f6 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:14.665410 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.wsgi [None req-ac2b15a7-a1c6-4d9d-8e45-8860160936f6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-ac2b15a7-a1c6-4d9d-8e45-8860160936f6 admin admin] Request method failure captured: Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Accept: application/json Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Accept-Encoding: gzip, deflate Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Connection: keep-alive Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Content-Length: 0 Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Host: 10.222.0.91 Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Openstack-Api-Version: compute 2.92 Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Openstack-System-Scope: None Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: User-Agent: python-novaclient Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Auth-Token: gAAAAABjGfPJqSR64rP9up6lHgJ1Wu_Zj5bawH0daOo2PeFEHfAfYjFjl0BlfB947XAzgHfJgBFLiXHGgPPKsitTb_9jTYGTpg5_jel3Qgj78w4qEtZLnNu4hozMEH16Cq1Z7F6Ja4ilq-cRF9jew4Pn58vRjwNfIl7agYjypvg17lEJKVjJESE Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Domain-Id: None Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Domain-Name: None Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Identity-Status: Confirmed Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Is-Admin-Project: True Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Domain-Id: default Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Domain-Name: Default Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Name: admin Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Role: member,admin,reader Sep 08 13:53:14.667033 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Roles: member,admin,reader Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/189571d729d54bff900838adb0030c5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_189571d729d54bff900838adb0030c5b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Tenant: admin Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Tenant-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Tenant-Name: admin Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User: admin Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Domain-Id: default Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Domain-Name: Default Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Id: c14eb0bf645e49f887a8d288d37d1491 Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Name: admin Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: method: > Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: exception: Flavor 84 could not be found. Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: action_args: {'id': '84'} Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:53:14.668587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:14.669539 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:14.670856 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-ac2b15a7-a1c6-4d9d-8e45-8860160936f6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:53:14.672212 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-ac2b15a7-a1c6-4d9d-8e45-8860160936f6 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.014346 Sep 08 13:53:14.672212 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 23/47] 10.222.0.91 () {60 vars in 1190 bytes} [Thu Sep 8 13:53:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:15.932088 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-ba2fd380-91fe-4a15-ac45-07b51c50302f admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:15.933101 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-ba2fd380-91fe-4a15-ac45-07b51c50302f admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 08 13:53:15.933497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 25/48] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:53:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:16.498436 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-a1622d20-66cb-48ad-bf6d-c454e7fac69c admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:16.505054 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.wsgi [None req-a1622d20-66cb-48ad-bf6d-c454e7fac69c admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-a1622d20-66cb-48ad-bf6d-c454e7fac69c admin admin] Request method failure captured: Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Accept: application/json Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Accept-Encoding: gzip, deflate Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Connection: keep-alive Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Content-Length: 0 Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Host: 10.222.0.91 Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Openstack-Api-Version: compute 2.92 Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Openstack-System-Scope: None Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: User-Agent: python-novaclient Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Auth-Token: gAAAAABjGfPLc8hKM1VlpHdH77whcz19-27CRssiMJPQHnRIezA_2ktvBKs4SNHoqvJrxUV_6In79DQQvs6Nd_whFhYjawKx8Nc8HN49JO_hM6kDocuYyiyh1_mU8hH1KZk3zTO0xrI24NLusP-WFGh_axJ3xtIIMS2ROuXy3eorYbjbSjqU4nw Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Domain-Id: None Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Domain-Name: None Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Identity-Status: Confirmed Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Is-Admin-Project: True Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Domain-Id: default Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Domain-Name: Default Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Project-Name: admin Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Role: member,admin,reader Sep 08 13:53:16.506689 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Roles: member,admin,reader Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/189571d729d54bff900838adb0030c5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_189571d729d54bff900838adb0030c5b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Tenant: admin Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Tenant-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-Tenant-Name: admin Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User: admin Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Domain-Id: default Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Domain-Name: Default Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Id: c14eb0bf645e49f887a8d288d37d1491 Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: X-User-Name: admin Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: method: > Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: exception: Flavor 451 could not be found. Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: action_args: {'id': '451'} Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:53:16.509352 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:16.510817 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: ERROR nova.api.openstack.wsgi Sep 08 13:53:16.512192 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-a1622d20-66cb-48ad-bf6d-c454e7fac69c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:53:16.513970 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-a1622d20-66cb-48ad-bf6d-c454e7fac69c admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.432041 Sep 08 13:53:16.513970 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 24/49] 10.222.0.91 () {60 vars in 1193 bytes} [Thu Sep 8 13:53:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:16.517988 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-7f1777cb-3746-4d44-a2d6-9acb988181a4 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:16.533511 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-7f1777cb-3746-4d44-a2d6-9acb988181a4 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018968 Sep 08 13:53:16.534076 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 26/50] 10.222.0.91 () {60 vars in 1210 bytes} [Thu Sep 8 13:53:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:53:16.544123 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:16.560353 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019927 Sep 08 13:53:16.560911 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 25/51] 10.222.0.91 () {60 vars in 1210 bytes} [Thu Sep 8 13:53:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:53:16.571475 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-9aad0c22-33a2-4c00-90be-9809d3662997 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:16.576932 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.wsgi [None req-9aad0c22-33a2-4c00-90be-9809d3662997 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-9aad0c22-33a2-4c00-90be-9809d3662997 admin admin] Request method failure captured: Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Accept: application/json Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Accept-Encoding: gzip, deflate Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Connection: keep-alive Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Content-Length: 0 Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Host: 10.222.0.91 Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Openstack-Api-Version: compute 2.92 Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Openstack-System-Scope: None Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: User-Agent: python-novaclient Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Auth-Token: gAAAAABjGfPLc8hKM1VlpHdH77whcz19-27CRssiMJPQHnRIezA_2ktvBKs4SNHoqvJrxUV_6In79DQQvs6Nd_whFhYjawKx8Nc8HN49JO_hM6kDocuYyiyh1_mU8hH1KZk3zTO0xrI24NLusP-WFGh_axJ3xtIIMS2ROuXy3eorYbjbSjqU4nw Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Domain-Id: None Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Domain-Name: None Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Identity-Status: Confirmed Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Is-Admin-Project: True Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Domain-Id: default Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Domain-Name: Default Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Project-Name: admin Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Role: member,admin,reader Sep 08 13:53:16.578497 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Roles: member,admin,reader Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/189571d729d54bff900838adb0030c5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_189571d729d54bff900838adb0030c5b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/189571d729d54bff900838adb0030c5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Tenant: admin Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Tenant-Id: 189571d729d54bff900838adb0030c5b Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-Tenant-Name: admin Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User: admin Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Domain-Id: default Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Domain-Name: Default Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Id: c14eb0bf645e49f887a8d288d37d1491 Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: X-User-Name: admin Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: method: > Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: exception: Flavor 451 could not be found. Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: action_args: {'id': '451'} Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:53:16.580002 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:16.580933 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: ERROR nova.api.openstack.wsgi Sep 08 13:53:16.582745 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-9aad0c22-33a2-4c00-90be-9809d3662997 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:53:16.584036 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-9aad0c22-33a2-4c00-90be-9809d3662997 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012399 Sep 08 13:53:16.584036 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 27/52] 10.222.0.91 () {60 vars in 1193 bytes} [Thu Sep 8 13:53:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:17.825321 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:17.826360 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Sep 08 13:53:17.826756 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 26/53] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:53:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:18.364073 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-f6b1a9cd-a86d-44d3-a9e1-84289725ae42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:18.443790 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-f6b1a9cd-a86d-44d3-a9e1-84289725ae42 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.477921 Sep 08 13:53:18.444255 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 28/54] 10.222.0.91 () {64 vars in 1235 bytes} [Thu Sep 8 13:53:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:53:19.677612 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:19.678631 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 08 13:53:19.679062 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 27/55] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:53:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:20.231087 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-3b863c4b-c0ab-4b18-896c-043e9606b9b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:20.302702 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-3b863c4b-c0ab-4b18-896c-043e9606b9b1 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.483507 Sep 08 13:53:20.303279 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 29/56] 10.222.0.91 () {64 vars in 1235 bytes} [Thu Sep 8 13:53:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:53:21.541587 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:21.542713 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Sep 08 13:53:21.543142 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 28/57] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:53:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:22.088532 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-f771a4af-ee7c-466f-8505-5eefaed9e599 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:22.186636 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-f771a4af-ee7c-466f-8505-5eefaed9e599 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.502476 Sep 08 13:53:22.187218 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 30/58] 10.222.0.91 () {64 vars in 1235 bytes} [Thu Sep 8 13:53:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:53:23.406366 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:23.407440 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Sep 08 13:53:23.407835 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 29/59] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:53:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:23.933758 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-badbb509-8527-472a-9957-243f0849b2aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:24.020603 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-badbb509-8527-472a-9957-243f0849b2aa admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.473225 Sep 08 13:53:24.021115 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 31/60] 10.222.0.91 () {64 vars in 1235 bytes} [Thu Sep 8 13:53:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:53:25.263193 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:25.264200 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 08 13:53:25.264595 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 30/61] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:53:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:25.794088 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-a01bf8d2-163f-420d-94b5-c3a1fbb44678 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:25.814659 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-a01bf8d2-163f-420d-94b5-c3a1fbb44678 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.413328 Sep 08 13:53:25.815217 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 32/62] 10.222.0.91 () {60 vars in 1202 bytes} [Thu Sep 8 13:53:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:23.055787 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.056732 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-d93ee2b4-df91-45d3-bbd4-00d48dcda0b4 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 08 13:54:23.057141 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 31/63] 10.222.0.91 () {54 vars in 931 bytes} [Thu Sep 8 13:54:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:23.068130 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:23.472095 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-7b47b602-066c-4837-b1fe-9a3bd622f68e admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.493192 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-7b47b602-066c-4837-b1fe-9a3bd622f68e admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.430032 Sep 08 13:54:23.493748 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 33/64] 10.222.0.91 () {60 vars in 1292 bytes} [Thu Sep 8 13:54:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:23.515255 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writing DB stats nova_api:SELECT=14 {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:23.519755 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-1483741d-b7c4-45cb-b108-5bc10cc4ca9f admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.527110 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-1483741d-b7c4-45cb-b108-5bc10cc4ca9f admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013277 Sep 08 13:54:23.527702 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 32/65] 10.222.0.91 () {60 vars in 1283 bytes} [Thu Sep 8 13:54:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:23.540109 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-cdea8ca1-1d26-47f4-8c64-051a16323b9a admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.547492 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-cdea8ca1-1d26-47f4-8c64-051a16323b9a admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011052 Sep 08 13:54:23.548007 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 34/66] 10.222.0.91 () {60 vars in 1286 bytes} [Thu Sep 8 13:54:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:23.559833 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-6f86ff0b-6977-4131-b3de-746fcc1599ab admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.567900 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-6f86ff0b-6977-4131-b3de-746fcc1599ab admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011885 Sep 08 13:54:23.568347 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 33/67] 10.222.0.91 () {60 vars in 1286 bytes} [Thu Sep 8 13:54:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:23.580594 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-f7487c16-85a1-4b7f-a4c8-944f4b8dda19 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.587619 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-f7487c16-85a1-4b7f-a4c8-944f4b8dda19 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011539 Sep 08 13:54:23.588139 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 35/68] 10.222.0.91 () {60 vars in 1283 bytes} [Thu Sep 8 13:54:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:40.775740 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-6f86ff0b-6977-4131-b3de-746fcc1599ab admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:40.777006 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-6f86ff0b-6977-4131-b3de-746fcc1599ab admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001748 Sep 08 13:57:40.777398 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 34/69] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:40.917149 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_api:SELECT=6 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:41.065787 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-10ddf332-d6d0-4f49-a018-e816ed091087 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:41.071190 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-10ddf332-d6d0-4f49-a018-e816ed091087 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:41.078182 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-10ddf332-d6d0-4f49-a018-e816ed091087 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:41.078182 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-10ddf332-d6d0-4f49-a018-e816ed091087 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:41.078182 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-10ddf332-d6d0-4f49-a018-e816ed091087 admin admin] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:41.078182 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-10ddf332-d6d0-4f49-a018-e816ed091087 admin admin] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:41.078571 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-10ddf332-d6d0-4f49-a018-e816ed091087 admin admin] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:41.105743 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-10ddf332-d6d0-4f49-a018-e816ed091087 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.189494 Sep 08 13:57:41.106324 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 36/70] 10.222.0.91 () {60 vars in 1193 bytes} [Thu Sep 8 13:57:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:57:42.217088 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-6f86ff0b-6977-4131-b3de-746fcc1599ab admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:42.218218 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-6f86ff0b-6977-4131-b3de-746fcc1599ab admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Sep 08 13:57:42.218694 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 35/71] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:42.422563 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-58953412-2521-44e1-8b45-eaf37b594bb4 admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:42.424693 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-58953412-2521-44e1-8b45-eaf37b594bb4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.425354 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-58953412-2521-44e1-8b45-eaf37b594bb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.426427 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-58953412-2521-44e1-8b45-eaf37b594bb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.427182 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-58953412-2521-44e1-8b45-eaf37b594bb4 admin admin] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.427632 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-58953412-2521-44e1-8b45-eaf37b594bb4 admin admin] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.428050 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-58953412-2521-44e1-8b45-eaf37b594bb4 admin admin] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.450453 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-58953412-2521-44e1-8b45-eaf37b594bb4 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.090043 Sep 08 13:57:42.451074 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 37/72] 10.222.0.91 () {60 vars in 1193 bytes} [Thu Sep 8 13:57:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:57:53.964305 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-6f86ff0b-6977-4131-b3de-746fcc1599ab admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:53.965644 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-6f86ff0b-6977-4131-b3de-746fcc1599ab admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 08 13:57:53.966065 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 36/73] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:57:54.108219 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_cell0:SELECT=4 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:54.108935 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_cell1:SELECT=4 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:54.109549 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG dbcounter [-] [117557] Writing DB stats nova_api:SELECT=8 {{(pid=117557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:54.158753 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-94a8cc43-0207-40e4-b96b-c3b5e02914cb admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:54.162822 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-94a8cc43-0207-40e4-b96b-c3b5e02914cb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:54.163316 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-94a8cc43-0207-40e4-b96b-c3b5e02914cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:54.163737 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-94a8cc43-0207-40e4-b96b-c3b5e02914cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:54.164437 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-94a8cc43-0207-40e4-b96b-c3b5e02914cb admin admin] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:54.164875 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-94a8cc43-0207-40e4-b96b-c3b5e02914cb admin admin] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:54.165313 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-94a8cc43-0207-40e4-b96b-c3b5e02914cb admin admin] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:54.190817 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-94a8cc43-0207-40e4-b96b-c3b5e02914cb admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086860 Sep 08 13:57:54.191380 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 38/74] 10.222.0.91 () {60 vars in 1193 bytes} [Thu Sep 8 13:57:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:55.275663 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG nova.api.openstack.wsgi [None req-6f86ff0b-6977-4131-b3de-746fcc1599ab admin admin] Calling method '>' {{(pid=117558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:55.276930 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: INFO nova.api.openstack.requestlog [None req-6f86ff0b-6977-4131-b3de-746fcc1599ab admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Sep 08 13:57:55.277431 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: [pid: 117558|app: 0|req: 37/75] 10.222.0.91 () {56 vars in 1074 bytes} [Thu Sep 8 13:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:57:55.471228 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG nova.api.openstack.wsgi [None req-ededb859-0ba8-4152-9d85-beb76e79805f admin admin] Calling method '>' {{(pid=117557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:55.475322 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-ededb859-0ba8-4152-9d85-beb76e79805f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:55.475832 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-ededb859-0ba8-4152-9d85-beb76e79805f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:55.476266 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-ededb859-0ba8-4152-9d85-beb76e79805f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:55.476986 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-ededb859-0ba8-4152-9d85-beb76e79805f admin admin] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:55.477432 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-ededb859-0ba8-4152-9d85-beb76e79805f admin admin] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:55.477849 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: DEBUG oslo_concurrency.lockutils [None req-ededb859-0ba8-4152-9d85-beb76e79805f admin admin] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:55.499850 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: INFO nova.api.openstack.requestlog [None req-ededb859-0ba8-4152-9d85-beb76e79805f admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080299 Sep 08 13:57:55.500417 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: [pid: 117557|app: 0|req: 39/76] 10.222.0.91 () {60 vars in 1193 bytes} [Thu Sep 8 13:57:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:52.610840 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: Thu Sep 8 13:58:52 2022 - graceful shutdown triggered... Sep 08 13:58:52.610991 dv-cinder-847733-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 08 13:58:52.611994 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: Gracefully killing worker 2 (pid: 117558)... Sep 08 13:58:52.612382 dv-cinder-847733-4-iscsi devstack@n-api.service[117557]: Gracefully killing worker 1 (pid: 117557)... Sep 08 13:58:52.741883 dv-cinder-847733-4-iscsi devstack@n-api.service[117558]: DEBUG dbcounter [-] [117558] Writing DB stats nova_api:SELECT=4 {{(pid=117558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:53.613083 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: worker 1 buried after 1 seconds Sep 08 13:58:53.614814 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: worker 2 buried after 1 seconds Sep 08 13:58:53.614814 dv-cinder-847733-4-iscsi devstack@n-api.service[117556]: goodbye to uWSGI. Sep 08 13:58:53.614685 dv-cinder-847733-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 08 13:58:53.615295 dv-cinder-847733-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 08 13:58:53.618100 dv-cinder-847733-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 13:58:53.627998 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 13:58:53.630570 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 13:58:53 2022] *** Sep 08 13:58:53.630721 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 13:58:53.630859 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 13:58:53.630991 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: nodename: dv-cinder-847733-4-iscsi Sep 08 13:58:53.631101 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: machine: x86_64 Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: clock source: unix Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: pcre jit disabled Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: detected number of CPU cores: 4 Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: current working directory: / Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: detected binary path: /usr/bin/uwsgi-core Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: your processes number limit is 47680 Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: your memory page size is 4096 bytes Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: detected max file descriptor number: 2048 Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: lock engine: pthread robust mutexes Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: thunder lock: enabled Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 13:58:53.641774 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 13:58:53.671176 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: Python main interpreter initialized at 0x55c78d8de9c0 Sep 08 13:58:53.671430 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: python threads support enabled Sep 08 13:58:53.671554 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: your server socket listen backlog is limited to 100 connections Sep 08 13:58:53.671675 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: your mercy for graceful operations on workers is 90 seconds Sep 08 13:58:53.672106 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 13:58:53.672325 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: *** Operational MODE: preforking *** Sep 08 13:58:53.672740 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: *** uWSGI is running in multiple interpreter mode *** Sep 08 13:58:53.672868 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: spawned uWSGI master process (pid: 133039) Sep 08 13:58:53.673209 dv-cinder-847733-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 13:58:53.676184 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: spawned uWSGI worker 1 (pid: 133058, cores: 1) Sep 08 13:58:53.676752 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: spawned uWSGI worker 2 (pid: 133059, cores: 1) Sep 08 13:58:53.683808 dv-cinder-847733-4-iscsi devstack@n-api.service[133039]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 13:58:54.335468 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 13:58:54.361106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 13:58:55.501086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:58:55.501086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: from cryptography.utils import int_from_bytes Sep 08 13:58:55.501854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:58:55.501854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: from cryptography.utils import int_from_bytes Sep 08 13:58:55.565741 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:58:55.565741 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: from cryptography.utils import int_from_bytes Sep 08 13:58:55.566363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:58:55.566363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: from cryptography.utils import int_from_bytes Sep 08 13:58:57.947663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:58:57.948259 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:58:57.948454 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:58:57.948815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:58:57.949069 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:58:57.949455 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.949776 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.950094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.950427 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.950739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.951071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.951386 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.951703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.952029 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.952289 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.952598 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.953043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-4-iscsi {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.953367 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.953670 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.953980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.954294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.954595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.954925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.955231 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.955725 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.957124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.957124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.957124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.957124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.957515 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.957720 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.958035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.958339 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.958663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.958970 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.959360 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-4-iscsi {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.959680 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.959989 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.960303 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.960700 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.961018 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.961324 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.961639 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.961955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.962271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.962581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.963061 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.963424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.963786 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.965535 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.965535 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.965535 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.965809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.965919 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.966384 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.966604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.966760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.967070 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.967395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.967711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.967960 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.968212 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.968528 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.968849 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.970089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.970089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.970089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.970089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.970613 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.970613 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.970949 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.971987 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.971987 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.971987 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.972449 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.972449 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.972760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.973227 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.973430 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.973616 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.973956 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.974271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.974577 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.974923 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.975227 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.975530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.975833 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.976135 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.976452 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.976784 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.977088 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.977336 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.977634 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.977938 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.978286 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.978590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.978980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.979276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.979610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.980574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.980880 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.981186 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.981492 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.981798 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.982102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.982405 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.982710 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.983036 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.983395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.983663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.983983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.984289 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.984594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.984899 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.985203 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.985526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.985830 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.986134 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.986453 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.986760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.987087 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.987406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.987713 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.988022 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.988337 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.988637 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.988940 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.989272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.989553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.989857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.990158 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.990459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.990760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.991089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.991389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.991690 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.991990 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.992309 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.992628 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.992935 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.993240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.993592 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.993856 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:57.994197 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.994528 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.994871 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.995206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.995749 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.996085 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.996403 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.996714 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.997026 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.997351 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.997662 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.998022 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.998335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.998650 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.999077 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.999415 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:57.999766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.000020 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.000365 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.000717 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.001025 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.001361 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.001690 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.002002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.002345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.002695 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.003037 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.003366 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.003807 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.004005 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.004315 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.004625 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.004968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.005279 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.005589 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.005908 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.006219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.006539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.006850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.007234 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.007499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.007810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.008181 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.008472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.008790 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.009112 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.009426 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.009747 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.010321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.010483 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.010722 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.011178 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.011488 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.011796 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.012101 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.012414 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.012719 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.013045 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.013377 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.014101 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.014101 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.014316 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.014622 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.015002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.015273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.015583 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.015898 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.016209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.016517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.016844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.017159 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.017508 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.017824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.018100 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.018406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.018726 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.019062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.019374 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.019689 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.020131 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.020304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.020617 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.020925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.021267 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.021630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.021937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.022498 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.022655 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.022873 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.023197 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.023509 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.023850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.024157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.024462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.024770 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.025071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.025631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.025959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.026578 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.026578 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.027449 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.027698 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.028004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.028309 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.028620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.028972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.029278 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.029621 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.029960 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.030278 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.030599 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.030949 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.031247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.031560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.031869 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.032177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.032486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.032805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.033116 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.033630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.033804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.034158 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.034409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.034726 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.035052 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.035370 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.035708 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.036045 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.036361 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.036682 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.036992 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.037307 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.037617 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.037926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.038233 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.038548 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.038865 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.039399 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.039725 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.040039 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.040365 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.040678 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.040998 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.041306 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.041617 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.041950 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.042336 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.043163 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.043475 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.043817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.044105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.044411 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.045261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.045261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.045425 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.045606 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.045919 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.046225 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.046538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.046840 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.047177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.047486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.047793 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.048101 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.048412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.048744 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.049214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.049706 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.050175 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.050648 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.051153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.051657 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.051974 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.052286 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.052593 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.052900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.053249 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.053563 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.053869 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.054188 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.054510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.054973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.055154 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.055461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.055770 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.056095 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.056410 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.056719 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.057078 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.057385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.057692 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.058034 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.058486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.058672 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.058993 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.059304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.059605 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.059912 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.060291 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.060810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.061138 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.061452 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.061767 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.062115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.062432 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.062759 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.063115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.063426 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.063732 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.064039 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.064339 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.064640 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.064949 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.065250 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.065556 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.065856 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.066160 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.066458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.066760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.067084 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.067389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.067705 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.068006 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.068312 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.068620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.068946 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.069253 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.069554 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.069854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.070157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.070500 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.070804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.071173 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.071504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.071846 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.072151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.072457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.072857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.073164 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.073486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.073794 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.074104 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.074411 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.074713 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.075042 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.075353 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.075664 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.075972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.076273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.076579 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.076882 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.077198 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.077506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.077810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.078111 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.078422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.078913 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.079367 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.079680 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.079979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.080299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.080603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.080716 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:58:58.081154 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.081257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:58:58.081348 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.081586 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:58:58.081708 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.081791 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.081869 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:58:58.082267 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.082446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:58:58.082605 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.082747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.082916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.083069 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.083223 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.083389 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.083533 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.083674 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.083822 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.083972 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.084126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.084268 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.084410 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.084553 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.084701 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.084843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.084993 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.085148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.085305 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.085446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.085589 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.085737 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.085891 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.086041 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-4-iscsi {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.086189 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.086330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.086489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.086769 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.086953 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.087104 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.087256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.087408 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.087550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.087702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.088043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.088210 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.088364 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.088514 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.088658 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.089070 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.089070 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.090044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.090044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.090386 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.090543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.090778 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.090959 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.091116 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.091116 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.091385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.091385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.091663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.091813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.091969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.092196 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.092545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.092712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.092865 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.093016 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.093158 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.093306 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.093456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.093456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.093734 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-4-iscsi {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.093876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.094025 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.094174 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.094345 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.094495 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.094637 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.094778 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.095038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.095203 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.095361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.095511 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.095661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.095802 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.095943 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.096118 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.096341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.096540 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.096719 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.096904 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.097092 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.097283 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.097471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.097657 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.097835 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.098013 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.098219 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.098438 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.098653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.099113 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.099280 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.099432 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.099584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.099735 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.100061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.100218 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.100373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.100516 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.100668 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.100907 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.101073 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.101741 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.101914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.102074 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.102269 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.102625 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.102781 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.102968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.103118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.103273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.103416 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.103578 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.103721 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.103864 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.104027 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.104180 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.104322 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.104465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.104606 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.104746 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.106642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.106812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.106988 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.107141 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.107289 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.107447 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.107666 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.107821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.108005 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.108157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.108313 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.108477 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.108636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.108636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.108917 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.109317 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.109488 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.109646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.109646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.110040 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.110282 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.110282 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.110578 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.110756 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.111123 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.111292 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.111451 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.111600 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.111757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.111914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.112062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.112210 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.112413 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.112776 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.112939 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.113119 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.113360 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.113525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.113675 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.113824 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.113972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.114134 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.114284 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.114457 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.114686 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.114882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.115098 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.115299 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.115299 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.115674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.115868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.116053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.116247 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.116431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.116626 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.116817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.117003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.117197 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.117396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.117581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.117773 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.117965 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.118150 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.118376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.118574 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.118574 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.118948 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.119120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.119506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.119669 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.119847 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.119997 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.120146 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.120311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.120553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.120721 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.120870 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.121037 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.121345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.121509 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.121658 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.121820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.121983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.122147 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.122296 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.122493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.122643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.123058 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.123216 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.123367 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.123516 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.123678 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.123827 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.123982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.124139 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.124300 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.124469 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.124619 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.124774 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.124924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.125078 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.125236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.125394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.125543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.125690 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.125838 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.125838 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.126128 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.126295 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.126450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.126610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.126760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.126934 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.127103 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.127253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.127412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.127562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.127716 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.127872 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.128037 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.128196 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.128372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.128532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.128681 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.128843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.128992 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.129140 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.129296 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.129684 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.129852 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.130026 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.130176 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.130325 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.130473 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.130739 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.130967 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.131168 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.131546 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.131715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.131907 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.132066 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.132224 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.132387 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.132592 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.132751 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.133054 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.133297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.133466 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.133617 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:58:58.133767 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.133924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.134074 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.134222 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.134385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.134385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.134677 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.134833 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.135034 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.135197 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.135401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.135561 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.135754 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.135915 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.136064 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.136227 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.136385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.136553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.136704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.136860 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.137010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.137212 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.137363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.137554 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.137705 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.137853 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.138002 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.138159 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.138309 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.138459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.138615 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.138771 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.138961 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.139132 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.139288 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.139448 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.139834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.139999 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.140159 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.140315 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.140470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.140619 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.140873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.141086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.141254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.141431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.141762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.141925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.142086 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.142244 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.142402 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.142597 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.142794 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.143103 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.143301 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.143534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.143534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.143841 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.144025 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.144188 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.144345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.144777 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.145073 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.145233 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.145384 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.145580 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.145737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.145971 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.146214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.146214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.146520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.146702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.146871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.147140 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.147298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.148062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.148231 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.148382 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.148540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.148718 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.148948 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.149142 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.149328 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.149524 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.150001 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.150193 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.150673 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.151110 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.151309 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.151463 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.152316 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.152483 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.152690 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.152853 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.153011 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.153342 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.153525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.153764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.153918 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.154086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.154235 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.154384 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.154542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.154542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.154834 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.155009 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.155159 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.155324 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.155474 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.155671 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.155821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.155969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.156137 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.156366 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.156517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.156672 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.156672 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.156984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.157139 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.157302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.157460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.157616 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.157772 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.157922 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.158081 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.158252 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.158401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.158549 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.158704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.158859 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.159172 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.159408 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.159563 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.159711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.160139 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.160302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.160465 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.160634 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.160790 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.160938 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.161089 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.161238 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.161417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.161662 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.161820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.161969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.162126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.162390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.162640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.162848 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.163032 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.163183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.163495 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.163666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.163902 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.164064 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.164224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.164381 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.164537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.164700 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.164851 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.165015 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.165164 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.165322 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.165485 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.165648 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.165804 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.165959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.165959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.166331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.166505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.166656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.166656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.167053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.167053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.167425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.168627 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.168786 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.168936 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.169094 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.169243 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.169403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.169403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.169694 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.169850 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.170128 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.170464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.170630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.170781 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.171016 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.171172 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.171321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.171470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.171766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.171926 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.172111 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.172264 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.172264 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.172975 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.173158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.173309 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.173309 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.173886 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.174115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.174279 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.174431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.174588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.174746 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.174936 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.175092 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.175253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.175403 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.175571 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.175722 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.175870 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.176018 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.176176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.176333 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.176489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.176489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.176779 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.177451 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.177621 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.177782 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.177931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.178099 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.178268 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.178994 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.179366 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.179528 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.179678 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.179835 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.179985 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.180246 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.180570 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.180733 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.180890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.181055 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.181211 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.181374 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.181531 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.181806 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.181972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.186447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.186644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.186644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.186995 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.187163 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.187326 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.187326 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.187635 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.187802 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.187952 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.188170 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.188339 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.188507 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.188667 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.189349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.190113 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.190373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.190708 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.190877 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.191067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.191230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.191389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.191539 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.191695 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.191851 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.192013 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.192162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.192310 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.192469 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.192618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.192773 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.193169 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.193339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.193502 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.193660 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.193808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.193970 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.194135 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.194291 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.194448 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.194605 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.194605 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.195017 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.195187 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.195345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.196035 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.197105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.197276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.197475 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.197645 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.197815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.197965 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.198115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.198271 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.198624 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.198806 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.198982 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.199146 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.199309 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.199473 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.199632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.199789 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.199940 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.200089 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.200247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.200522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.200881 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.201041 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.201204 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.201354 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.201354 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.201674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.201839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.201997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.202154 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.202303 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.202460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.202624 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.202774 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.202954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.203418 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.203418 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.203735 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.203899 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.204069 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.204236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.204403 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.204566 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.204717 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.204872 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.205022 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.205178 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.205327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.205485 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.205636 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.205793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.205941 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.206102 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.206265 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.206415 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.206415 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.206737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.207244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.207244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.207244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.207723 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.207874 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.208024 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.208173 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.208335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.208493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.208650 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.208799 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.208949 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.209106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.209271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.209429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.209586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.209785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.209935 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.210095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.210254 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.210416 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.210658 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.211000 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.211169 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.211318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.211480 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.211631 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.211780 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.211930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.212079 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.212236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.212396 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.212557 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.212714 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.212873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.213060 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.213356 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.213611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.213775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.213775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.213775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.214722 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.214909 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.215079 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.215240 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.215412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.215582 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.215745 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.215907 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.216058 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.216215 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.216364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.216512 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.216671 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.216821 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.216977 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.218350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.218533 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.218696 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.218855 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.219063 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.219285 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.219480 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.219676 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.219873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.220060 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.220244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.220439 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.220755 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.221159 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.221367 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.221552 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.221745 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.221941 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.222138 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.222322 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.222509 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.222509 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.222509 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.223073 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.223482 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.223482 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.223891 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.224042 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.224182 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.224319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.224476 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.224476 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.224735 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.224871 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.225007 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.225160 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.225324 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.225473 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.225611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.225756 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.225899 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.226046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.226183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.226319 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.226465 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.226601 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.226737 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.226884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.227052 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.227438 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.227581 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.227733 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.227898 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.228056 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.228208 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.228459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.228613 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.228751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.228751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.229019 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.229159 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.229294 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.229438 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.229586 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.229781 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.230423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.230570 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.230706 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.231020 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.231334 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.231492 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.231630 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.231766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.231914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.232051 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.232198 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.232335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.232500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.232649 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.232785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.232921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.233078 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.233224 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.233382 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.233649 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.233813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.234029 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.234196 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.234333 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.234470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.234616 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.234764 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.234764 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.235057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.235057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.235344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.235344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.235562 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.235653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.235779 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.235868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.235949 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236030 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236149 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236248 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236324 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236475 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236548 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236628 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236714 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236788 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.236931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.237003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.237087 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.237172 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.237246 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.237339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.237629 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.237717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.237809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.237890 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.237969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238049 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238122 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238204 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238285 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238430 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238666 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238747 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238747 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.238876 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239207 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239207 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239382 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239463 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239463 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239600 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239672 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239672 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239811 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239891 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.239970 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240054 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240211 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240299 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240457 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240457 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240599 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240690 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240776 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.240938 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.241028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.241104 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.241205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.241497 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.241580 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.241652 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.241731 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.241811 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.241901 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.241981 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242054 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242133 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:58:58.242205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.242736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.243607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.243607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.243607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.243607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.243607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.243607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.243607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.243607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.244681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.245908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246921 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246921 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246921 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246921 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246921 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246921 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246921 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.246921 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.247762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.247762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.247762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.247762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.247762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.247762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.247762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.248248 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.248248 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.248517 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.253061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.253061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.253061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.253061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.253061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.253061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.253061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.253061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254572 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254572 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.254572 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.255369 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.255369 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.255555 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.255867 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.256109 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.256421 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.256731 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.257063 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.257375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.257854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.258044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.258350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.258677 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.259013 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.259344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.259663 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.259972 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.260281 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.260591 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.260943 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.261337 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.261599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.261936 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.262273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.262591 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.262955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.263335 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.263609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.263927 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.264253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.264583 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.264895 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.265206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.265521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.265830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.266809 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.266809 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.266809 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.267281 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.267444 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.267651 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.268012 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.268537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.269167 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.269167 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.269493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.269711 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.270024 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.270377 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.270692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.271065 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.271410 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.271717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.272041 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.272365 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.272685 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.273009 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.273407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.273649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.273964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.274275 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.274624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.274972 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.275294 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.276125 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.276462 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.277314 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.277632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.278155 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.278330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.278584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.279441 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.279441 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.279745 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.279900 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.280166 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.280497 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.281030 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.281198 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.281637 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.281865 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.282165 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.282489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.282856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.283054 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO dbcounter [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Registered counter for database nova_api Sep 08 13:58:58.283230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.283661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.283835 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.284124 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.284417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.284974 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.285153 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.285462 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.285783 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.286149 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.286464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.286787 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.287207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.287525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.287826 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.288500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.288500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.288834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.289095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.290120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.290120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.290459 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.290636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.292022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.292022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.292022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.292022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.293508 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.293508 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.294344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.294344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.294344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.295049 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.295049 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.295351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.295536 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.295713 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.296284 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.296718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.296973 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.297310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.297649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.298093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.298324 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.298661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.300254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.300254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.300254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.300861 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.300861 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.301167 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.301267 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.301555 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.301870 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.302193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.302506 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.302841 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.303292 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.303529 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.303848 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.304164 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.304476 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.304806 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.305066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_db.sqlalchemy.engines [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:58:58.305202 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.305422 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.305723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.306041 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.306464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.306781 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.307126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.307486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.307803 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.308145 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.308486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.308800 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.309110 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.309437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.309754 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.310082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.310430 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.310742 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.311123 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.311449 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.311833 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writer thread running {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:58:58.312007 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.312357 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.312684 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.313029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.313367 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.313679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.313991 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.314298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.314628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.314976 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.315298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.315615 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.315956 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.316269 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.316585 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.316901 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.317217 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.317533 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.317842 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.318148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.318473 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.318886 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.319123 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.319489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.319799 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.320120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.320443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.320866 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.321394 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.321552 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.321814 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.322130 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.322534 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.322925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.323268 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.324181 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.324427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.324984 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.325304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.325634 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.325987 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.326286 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.326620 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.326972 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.327294 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.327623 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.327940 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.328277 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.328622 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.328968 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.329298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.329609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.329921 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.330230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.330543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.330868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.331208 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.331518 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.331827 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.332140 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.332447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.332777 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.333085 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.333396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.333709 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.334015 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.334323 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.334628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.334955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.335265 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.335575 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.335888 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.336195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.336505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.336813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.337121 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.337428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.337767 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.338656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.338656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.338846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.339781 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.340079 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.340396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.340724 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.341051 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.341373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.341689 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.342027 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.342342 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.342657 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.343001 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.343315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.343630 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.343944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.344276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.344607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.344916 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.345245 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.345568 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.345894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.346216 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.346530 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.346864 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.347208 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.347524 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.347845 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.348267 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.348589 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.348915 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.349322 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.349632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.349955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.350276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.350636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.350989 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.351307 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.351638 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.351971 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.352322 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.352639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.352991 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.353324 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.353643 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.353960 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.354271 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:58:58.354518 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:58:58.370129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.context [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43ffdb1b-6a17-4540-82fa-c15e3a06dc21(cell1) {{(pid=133059) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 13:58:58.374200 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:58.374669 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:58.376239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:58.376973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:58.377413 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:58.379399 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:58.381373 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO dbcounter [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Registered counter for database nova_cell0 Sep 08 13:58:58.385347 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO dbcounter [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Registered counter for database nova_cell1 Sep 08 13:58:58.393023 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_db.sqlalchemy.engines [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:58:58.395080 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_db.sqlalchemy.engines [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:58:58.402762 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writer thread running {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:58:58.404054 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writer thread running {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:58:58.418600 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO dbcounter [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Registered counter for database nova_api Sep 08 13:58:58.438848 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:58:58.445750 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writer thread running {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:58:58.504612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.context [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43ffdb1b-6a17-4540-82fa-c15e3a06dc21(cell1) {{(pid=133058) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 13:58:58.508718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:58.509216 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:58.510811 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:58.512112 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:58.512584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:58.514575 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:58.516775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO dbcounter [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Registered counter for database nova_cell0 Sep 08 13:58:58.520942 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO dbcounter [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Registered counter for database nova_cell1 Sep 08 13:58:58.528314 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:58:58.534469 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:58:58.536079 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writer thread running {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:58:58.552098 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO dbcounter [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Registered counter for database nova_cell0 Sep 08 13:58:58.559102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_db.sqlalchemy.engines [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:58:58.565383 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writer thread running {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:58:58.681430 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writer thread running {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:58:58.690798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO dbcounter [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Registered counter for database nova_cell0 Sep 08 13:58:58.697807 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:58:58.703096 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writer thread running {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:58:58.920626 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: WARNING keystonemiddleware.auth_token [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:58:58.928709 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: WARNING keystonemiddleware.auth_token [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:58:59.031460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: WARNING keystonemiddleware.auth_token [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:58:59.039207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: WARNING keystonemiddleware.auth_token [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:58:59.279365 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: WARNING keystonemiddleware.auth_token [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:58:59.286595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: WARNING keystonemiddleware.auth_token [None req-34a795f1-a984-4b92-b47c-83608c20ffb4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:58:59.292720 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c78d8de9c0 pid: 133059 (default app) Sep 08 13:58:59.393376 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: WARNING keystonemiddleware.auth_token [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:58:59.399479 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: WARNING keystonemiddleware.auth_token [None req-e4c6daca-1cd6-48df-aaaa-2e22fc014563 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:58:59.405790 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c78d8de9c0 pid: 133058 (default app) Sep 08 13:59:36.220834 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=3 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:36.221932 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=3 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:36.222664 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=3 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:36.223603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=3 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:37.656806 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-34fde31c-0aeb-4988-a6f7-985fca26de43 tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] Action: 'create', calling method: .version_select at 0x7f5200f54430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-345098258", "metadata": {"Type": "work"}}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:40.439556 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-34fde31c-0aeb-4988-a6f7-985fca26de43 tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.235111 Sep 08 13:59:40.440857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 1/1] 10.222.0.91 () {60 vars in 1156 bytes} [Thu Sep 8 13:59:36 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4238 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 13:59:40.838192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-eca7aeb6-8053-4bd2-820b-b8c924a0aaec tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] Calling method '.version_select at 0x7f52010024c0>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:40.889179 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:40.890404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:40.891545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:40.892719 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:41.304925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-eca7aeb6-8053-4bd2-820b-b8c924a0aaec tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe" status: 200 len: 352 microversion: 2.1 time: 0.848531 Sep 08 13:59:41.304925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 1/2] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:40 2022] GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe => generated 352 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:42.320676 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4b8af75c-4de2-44b5-beff-d3e292d76007 tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] Calling method '.version_select at 0x7f5200e25310>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:42.417003 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4b8af75c-4de2-44b5-beff-d3e292d76007 tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe" status: 200 len: 353 microversion: 2.1 time: 0.102791 Sep 08 13:59:42.418833 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 2/3] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:42 2022] GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:42.432246 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3f9981ed-f7c6-4e2e-9f49-297d9a20b278 tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] Calling method '.version_select at 0x7f5200e16550>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:42.560115 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3f9981ed-f7c6-4e2e-9f49-297d9a20b278 tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe" status: 200 len: 353 microversion: 2.1 time: 0.132019 Sep 08 13:59:42.560675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 2/4] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:42 2022] GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:42.575523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-00b4ed01-2a70-486a-862e-6989917976da tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] Calling method '.version_select at 0x7f5200e259d0>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:43.004094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-00b4ed01-2a70-486a-862e-6989917976da tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe" status: 202 len: 0 microversion: 2.1 time: 0.432600 Sep 08 13:59:43.005152 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 3/5] 10.222.0.91 () {58 vars in 1248 bytes} [Thu Sep 8 13:59:42 2022] DELETE /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:59:43.015822 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-95193c2a-4b61-4116-a70f-881fbb2f9e73 tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] Calling method '.version_select at 0x7f5200e16160>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:43.078826 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-95193c2a-4b61-4116-a70f-881fbb2f9e73 tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe" status: 200 len: 352 microversion: 2.1 time: 0.068048 Sep 08 13:59:43.079681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 3/6] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:43 2022] GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:44.094177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2b635490-caae-4859-b3c3-df04d3f7e5ad tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] Calling method '.version_select at 0x7f5200dbe0d0>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:44.159874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-2b635490-caae-4859-b3c3-df04d3f7e5ad tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] HTTP exception thrown: Volume 4d67c1b7-c6a5-4e01-b222-ec99f7929cbe could not be found. Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2b635490-caae-4859-b3c3-df04d3f7e5ad tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] Request method failure captured: Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe HTTP/1.1 Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVIYnYgeHu8H2kc9RzkpOIFbNSOaqmU-utIvEW6SyV3YSSymuS7kqHUn_Vo2REeiVkexk4cBClPDsXI3K0Qkxgjvmb8hK8l58rmr7QuXhIhDTYwnwGTppWTcDIozKS00LxfrqRORwdxfTadtpkeakGvkLBsE7qgQH1qQLYUKHxBKKM Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 266ca24a1fb44f9992e9eb372695bdc6 Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-VolumesGetTestJSON-994997134 Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 13:59:44.164400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/266ca24a1fb44f9992e9eb372695bdc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/266ca24a1fb44f9992e9eb372695bdc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_266ca24a1fb44f9992e9eb372695bdc6", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/266ca24a1fb44f9992e9eb372695bdc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-VolumesGetTestJSON-994997134 Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 266ca24a1fb44f9992e9eb372695bdc6 Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-VolumesGetTestJSON-994997134 Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-VolumesGetTestJSON-994997134-project Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 73601a32878240dd85194e733a671a86 Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-VolumesGetTestJSON-994997134-project Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Volume 4d67c1b7-c6a5-4e01-b222-ec99f7929cbe could not be found. Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '4d67c1b7-c6a5-4e01-b222-ec99f7929cbe'} Sep 08 13:59:44.165610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d67c1b7-c6a5-4e01-b222-ec99f7929cbe could not be found. (HTTP 404) (Request-ID: req-b981036c-efa5-4654-bc4c-e28b081e9963) Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:59:44.166376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:59:44.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d67c1b7-c6a5-4e01-b222-ec99f7929cbe could not be found. Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 13:59:44.174499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d67c1b7-c6a5-4e01-b222-ec99f7929cbe could not be found. Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d67c1b7-c6a5-4e01-b222-ec99f7929cbe could not be found. Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2b635490-caae-4859-b3c3-df04d3f7e5ad tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] Returning 404 to user: Volume 4d67c1b7-c6a5-4e01-b222-ec99f7929cbe could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2b635490-caae-4859-b3c3-df04d3f7e5ad tempest-VolumesGetTestJSON-994997134 tempest-VolumesGetTestJSON-994997134-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe" status: 404 len: 109 microversion: 2.1 time: 0.079158 Sep 08 13:59:44.175503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 4/7] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:44 2022] GET /compute/v2.1/os-volumes/4d67c1b7-c6a5-4e01-b222-ec99f7929cbe => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:59:51.385770 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-66df8a3c-b08c-4195-989d-2a57554402d0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'create', calling method: .version_select at 0x7f5200e16f70>, body: {"keypair": {"name": "tempest-keypair-1019235176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyyM39QnffWawHx/mS0rSyAjiDhZhow4ukaaXP6b7V0hvK2YmuyurmnQgf8sOc3zf44WY7Ayr1yFs/G7y9oUfbFUE/FncwS577VY9MVIcIpO4aevm8VYziwjXmPNF9lXQ=="}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:51.487168 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-66df8a3c-b08c-4195-989d-2a57554402d0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Getting quotas for project 4d0ed4e4f54c47369721e871f0dec518. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:59:51.496534 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-66df8a3c-b08c-4195-989d-2a57554402d0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Getting quotas for user 7b403bdc9cad4783b72bbf174199363c and project 4d0ed4e4f54c47369721e871f0dec518. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:59:51.720833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-66df8a3c-b08c-4195-989d-2a57554402d0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.897537 Sep 08 13:59:51.722348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 4/8] 10.222.0.91 () {60 vars in 1159 bytes} [Thu Sep 8 13:59:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:53.919801 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3b19dd01-580c-452b-a8f0-71606eddd4f1 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5200dbea60>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:53.983660 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3b19dd01-580c-452b-a8f0-71606eddd4f1 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/c7088456-77f9-4ea2-a85e-fa9f3a8e124a" status: 200 len: 350 microversion: 2.1 time: 0.069779 Sep 08 13:59:53.984389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 5/9] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:53 2022] GET /compute/v2.1/os-volumes/c7088456-77f9-4ea2-a85e-fa9f3a8e124a => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:56.287420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d69aa2e5-620a-4f29-9120-1ff893bac615 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5200d980d0>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:56.415526 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d69aa2e5-620a-4f29-9120-1ff893bac615 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/a909b09b-7d55-492f-b9a9-b56f24e2cc6b" status: 200 len: 350 microversion: 2.1 time: 0.132346 Sep 08 13:59:56.416400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 5/10] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:56 2022] GET /compute/v2.1/os-volumes/a909b09b-7d55-492f-b9a9-b56f24e2cc6b => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:59:58.902874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-413a444f-ecda-4c55-97dc-d77476f03273 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5200da8160>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:59.002105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-413a444f-ecda-4c55-97dc-d77476f03273 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/bff98eb2-f358-472b-820d-53a1646a8784" status: 200 len: 351 microversion: 2.1 time: 0.105053 Sep 08 13:59:59.025416 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2ea7728a-f08e-407c-b3b4-db5d59e39e3b tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5200d98d30>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:59.026405 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 6/11] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:58 2022] GET /compute/v2.1/os-volumes/bff98eb2-f358-472b-820d-53a1646a8784 => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:59.186815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2ea7728a-f08e-407c-b3b4-db5d59e39e3b tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.172233 Sep 08 13:59:59.190928 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 6/12] 10.222.0.91 () {58 vars in 1134 bytes} [Thu Sep 8 13:59:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:59.205275 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ed67800d-43db-4d9d-a94a-46b12a7691b4 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5200dbef70>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:59.329817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ed67800d-43db-4d9d-a94a-46b12a7691b4 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.128702 Sep 08 13:59:59.330391 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 7/13] 10.222.0.91 () {58 vars in 1149 bytes} [Thu Sep 8 13:59:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:59.349882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4a03160f-790e-4897-803b-970a05c615ce tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5200d480d0>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:59.476384 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4a03160f-790e-4897-803b-970a05c615ce tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.130509 Sep 08 13:59:59.477518 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 7/14] 10.222.0.91 () {58 vars in 1134 bytes} [Thu Sep 8 13:59:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:59.493829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d9e9ed0e-2274-40dc-adb6-f844d21e824f tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5200da88b0>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:59.622234 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d9e9ed0e-2274-40dc-adb6-f844d21e824f tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.134496 Sep 08 13:59:59.625545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 8/15] 10.222.0.91 () {58 vars in 1167 bytes} [Thu Sep 8 13:59:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:59.641773 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2ed05ef2-9194-4051-92e3-cc862c585096 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5201782790>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:59.815574 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2ed05ef2-9194-4051-92e3-cc862c585096 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.179883 Sep 08 13:59:59.816885 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 8/16] 10.222.0.91 () {58 vars in 1170 bytes} [Thu Sep 8 13:59:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:59.830563 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f7455866-096c-45e2-ab7f-a40d66dbfcf7 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5200da9c10>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:59.972170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f7455866-096c-45e2-ab7f-a40d66dbfcf7 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.135991 Sep 08 13:59:59.973898 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 9/17] 10.222.0.91 () {58 vars in 1155 bytes} [Thu Sep 8 13:59:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:59.979033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f36f611c-a10f-450d-bd66-ca99b619ea7f tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5200d48040>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:00.080609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f36f611c-a10f-450d-bd66-ca99b619ea7f tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.106889 Sep 08 14:00:00.081363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 9/18] 10.222.0.91 () {58 vars in 1188 bytes} [Thu Sep 8 13:59:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:00.105957 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-58bb2d94-c4bd-4aab-a965-6de284f234f9 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] Calling method '.version_select at 0x7f5200f54ee0>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:00.312345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-58bb2d94-c4bd-4aab-a965-6de284f234f9 tempest-VolumesTestJSON-612444274 tempest-VolumesTestJSON-612444274-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.218292 Sep 08 14:00:00.315679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 10/19] 10.222.0.91 () {58 vars in 1155 bytes} [Thu Sep 8 14:00:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:00.389114 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1616538925", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58c8bc7a-6681-4b5a-acdc-437bbe7f81ec"}], "security_groups": [{"name": "tempest-securitygroup--431184291"}], "key_name": "tempest-keypair-1019235176", "user_data": "}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:00.762368 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] validate_networks() for [('58c8bc7a-6681-4b5a-acdc-437bbe7f81ec', None, None, None, None, None)] {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:00:00.989170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1668018189", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "networks": [{"uuid": "563f440b-474a-43d0-8464-ca41149ada44"}]}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:01.168339 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] validate_networks() for [('563f440b-474a-43d0-8464-ca41149ada44', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:00:01.518030 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=4 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:02.391237 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:00:02.391916 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:00:02.392619 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:00:02.393466 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:00:02.394125 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:00:02.414386 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:02.416520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:02.417491 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:02.421211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:02.437484 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:02.438268 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:02.505548 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Getting quotas for project 4d0ed4e4f54c47369721e871f0dec518. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:00:02.524627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Getting quotas for user 7b403bdc9cad4783b72bbf174199363c and project 4d0ed4e4f54c47369721e871f0dec518. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:00:02.547481 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:00:02.552689 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:00:02.767623 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-34880721-0a99-4b14-83e8-3ca1b5689fd0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.383674 Sep 08 14:00:02.769003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 10/20] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:00:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:00:02.814450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:00:02.814977 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:00:02.815367 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:00:02.815774 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:00:02.816183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:00:02.856581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:02.857502 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:02.858322 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:02.869266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:02.870042 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:02.870530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:02.945582 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Getting quotas for project f768b4d35c1b4713b58e3d582adcc93f. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:00:02.966582 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Getting quotas for user 5771e9d0c5c94306b3ec571916acdcaa and project f768b4d35c1b4713b58e3d582adcc93f. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:00:03.001051 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:00:03.004460 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:00:03.269093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f7851a5c-eb0b-498a-b8aa-3451e9220e70 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.556477 Sep 08 14:00:03.284240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 11/21] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:00:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:00:03.337930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1825889738", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:03.421887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] validate_networks() for [('955cd46c-55dd-4620-a904-f617035eddf3', None, None, None, None, None)] {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:00:03.840641 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0f135dab-8258-4eb4-84e5-430456114618 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: .version_select at 0x7f5200cb5160>, body: {"keypair": {"name": "tempest-keypair-1159232242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzsH7NJa7UnH9Y3C5V+oHcfHVe65IPFvJwVipyBeQWn3tulkoooaio8iDCAvnqF8ej5xz+hXaLTawlw//PGFr2cHMSBlPxQec92Fl265WWPL5rlDNmFDAsgHqyWBBrlpQ=="}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:03.861834 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-0f135dab-8258-4eb4-84e5-430456114618 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'key_pairs'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:00:03.870876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-0f135dab-8258-4eb4-84e5-430456114618 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for user beb41eb66e8140a6999b0bddab3c4afd and project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'key_pairs'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:00:04.242387 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:00:04.244184 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:00:04.245782 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:00:04.246822 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:00:04.247615 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:00:04.264325 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:04.265149 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:04.265894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:04.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:04.268288 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:04.269293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:04.345432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Getting quotas for project 2078beb45799497ea367c552b6d8bcf9. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:00:04.376713 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Getting quotas for user e4916206c2ff42669276e0a93d6483ab and project 2078beb45799497ea367c552b6d8bcf9. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:00:04.412505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0f135dab-8258-4eb4-84e5-430456114618 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.125546 Sep 08 14:00:04.413877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 12/22] 10.222.0.91 () {60 vars in 1159 bytes} [Thu Sep 8 14:00:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:04.450953 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f9b3d4b8-5c36-4b70-9136-c443773e2f94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:04.453386 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f9b3d4b8-5c36-4b70-9136-c443773e2f94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:04.470279 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:00:04.474653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:00:04.755390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f9b3d4b8-5c36-4b70-9136-c443773e2f94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:04.775307 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f9b3d4b8-5c36-4b70-9136-c443773e2f94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1238 microversion: 2.1 time: 0.359429 Sep 08 14:00:04.777209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 13/23] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:04 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1238 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:04.786329 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-66d20eec-ce80-42cc-845e-151b119f55de tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:04.788038 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-66d20eec-ce80-42cc-845e-151b119f55de tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:04.806425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f9cb057d-8f8f-432d-8ab5-ea314a5244d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.035648 Sep 08 14:00:04.831249 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 11/24] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:00:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:00:04.837503 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-46cec036-4f58-4236-a7a9-a225da60bd6d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:04.840374 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-46cec036-4f58-4236-a7a9-a225da60bd6d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:04.998986 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-66d20eec-ce80-42cc-845e-151b119f55de tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:05.016427 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-66d20eec-ce80-42cc-845e-151b119f55de tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1215 microversion: 2.1 time: 0.237400 Sep 08 14:00:05.017029 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 14/25] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:04 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:05.244498 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-46cec036-4f58-4236-a7a9-a225da60bd6d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:05.299462 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-46cec036-4f58-4236-a7a9-a225da60bd6d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1222 microversion: 2.1 time: 0.465964 Sep 08 14:00:05.300352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 12/26] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:04 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1222 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:05.517398 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1904022475", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:05.608917 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] validate_networks() for [('955cd46c-55dd-4620-a904-f617035eddf3', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:00:05.806215 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a0766242-f33b-4fb0-b44f-20c87478e73d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:05.808368 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a0766242-f33b-4fb0-b44f-20c87478e73d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:06.000017 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a0766242-f33b-4fb0-b44f-20c87478e73d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:06.008779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a0766242-f33b-4fb0-b44f-20c87478e73d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1238 microversion: 2.1 time: 0.209429 Sep 08 14:00:06.011472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 13/27] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:05 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1238 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:06.047669 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2ed1f69b-ce8d-4598-8a13-13ef984cfb19 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:06.055084 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2ed1f69b-ce8d-4598-8a13-13ef984cfb19 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:06.285564 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2ed1f69b-ce8d-4598-8a13-13ef984cfb19 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:06.308300 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2ed1f69b-ce8d-4598-8a13-13ef984cfb19 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1215 microversion: 2.1 time: 0.269784 Sep 08 14:00:06.311451 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 14/28] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:06 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1215 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:06.669997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:00:06.670561 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:00:06.671941 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:00:06.672627 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:00:06.673311 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:00:06.693132 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:06.694056 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:06.694713 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:06.696154 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:06.697007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:06.697706 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:06.790044 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Getting quotas for project 2078beb45799497ea367c552b6d8bcf9. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:00:06.796139 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Getting quotas for user e4916206c2ff42669276e0a93d6483ab and project 2078beb45799497ea367c552b6d8bcf9. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:00:06.810461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:00:06.815636 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:00:07.042533 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ac7997c0-553a-4287-abeb-62b059fd5732 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:07.042533 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ac7997c0-553a-4287-abeb-62b059fd5732 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:07.045368 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac7997c0-553a-4287-abeb-62b059fd5732 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:07.045876 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac7997c0-553a-4287-abeb-62b059fd5732 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:07.046322 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac7997c0-553a-4287-abeb-62b059fd5732 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:07.047058 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac7997c0-553a-4287-abeb-62b059fd5732 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:07.047551 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac7997c0-553a-4287-abeb-62b059fd5732 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:07.047974 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac7997c0-553a-4287-abeb-62b059fd5732 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:07.122074 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-293f072a-273b-4734-85ef-e2dc1a584300 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.609187 Sep 08 14:00:07.125640 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 15/29] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:00:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:00:07.163528 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6a27259e-b7c9-4bdb-a476-feea1f4c53db tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:07.174590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6a27259e-b7c9-4bdb-a476-feea1f4c53db tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:07.417910 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-6a27259e-b7c9-4bdb-a476-feea1f4c53db tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:07.427142 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6a27259e-b7c9-4bdb-a476-feea1f4c53db tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1222 microversion: 2.1 time: 0.273655 Sep 08 14:00:07.450618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 16/30] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:07 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1222 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:07.461654 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ac7997c0-553a-4287-abeb-62b059fd5732 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:07.494673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-daef0b9f-b7d3-4ecd-97ee-76232504ea76 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:07.499609 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-daef0b9f-b7d3-4ecd-97ee-76232504ea76 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:07.558364 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ac7997c0-553a-4287-abeb-62b059fd5732 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1242 microversion: 2.1 time: 0.523087 Sep 08 14:00:07.561600 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 15/31] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:07 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1242 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:07.766106 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-daef0b9f-b7d3-4ecd-97ee-76232504ea76 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:07.800929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-daef0b9f-b7d3-4ecd-97ee-76232504ea76 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1215 microversion: 2.1 time: 0.322775 Sep 08 14:00:07.800929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 17/32] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:07 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1215 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:08.486858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-41cc2c35-88b4-41fc-a480-a86824533c69 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:08.487679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-41cc2c35-88b4-41fc-a480-a86824533c69 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:08.574405 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-41cc2c35-88b4-41fc-a480-a86824533c69 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:08.585573 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a7df15de-2c13-4491-b165-4da98d920126 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:08.587093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a7df15de-2c13-4491-b165-4da98d920126 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:08.587798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-41cc2c35-88b4-41fc-a480-a86824533c69 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1222 microversion: 2.1 time: 0.108408 Sep 08 14:00:08.596650 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7df15de-2c13-4491-b165-4da98d920126 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:08.597143 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7df15de-2c13-4491-b165-4da98d920126 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:08.597757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7df15de-2c13-4491-b165-4da98d920126 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:08.598674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7df15de-2c13-4491-b165-4da98d920126 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:08.599152 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7df15de-2c13-4491-b165-4da98d920126 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:08.599581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7df15de-2c13-4491-b165-4da98d920126 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:08.603532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 16/33] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:08 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:08.760594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a7df15de-2c13-4491-b165-4da98d920126 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:08.799587 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a7df15de-2c13-4491-b165-4da98d920126 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1234 microversion: 2.1 time: 0.218801 Sep 08 14:00:08.801337 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 18/34] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:08 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1234 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:08.825091 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d3822279-42a1-41f9-864a-a7993740c17f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:08.826323 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d3822279-42a1-41f9-864a-a7993740c17f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:08.835709 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d3822279-42a1-41f9-864a-a7993740c17f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:08.836515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d3822279-42a1-41f9-864a-a7993740c17f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:08.839282 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d3822279-42a1-41f9-864a-a7993740c17f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:08.842290 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d3822279-42a1-41f9-864a-a7993740c17f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:08.843123 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d3822279-42a1-41f9-864a-a7993740c17f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:08.843659 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d3822279-42a1-41f9-864a-a7993740c17f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:09.047505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d3822279-42a1-41f9-864a-a7993740c17f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:09.094748 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d3822279-42a1-41f9-864a-a7993740c17f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1211 microversion: 2.1 time: 0.274305 Sep 08 14:00:09.095420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 17/35] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:08 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1211 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:09.613466 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1133fb14-af27-4f22-a559-68e7b0fe6bbd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:09.614079 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1133fb14-af27-4f22-a559-68e7b0fe6bbd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:09.621858 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1133fb14-af27-4f22-a559-68e7b0fe6bbd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:09.622492 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1133fb14-af27-4f22-a559-68e7b0fe6bbd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:09.622606 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1133fb14-af27-4f22-a559-68e7b0fe6bbd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:09.623287 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1133fb14-af27-4f22-a559-68e7b0fe6bbd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:09.623743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1133fb14-af27-4f22-a559-68e7b0fe6bbd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:09.624313 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1133fb14-af27-4f22-a559-68e7b0fe6bbd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:09.652276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2084543437", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38509184-249f-4b78-9ab0-339bc3caa638"}], "security_groups": [{"name": "tempest-securitygroup--1688651984"}], "key_name": "tempest-keypair-1159232242", "user_data": "}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:09.770138 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1133fb14-af27-4f22-a559-68e7b0fe6bbd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:09.779143 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1133fb14-af27-4f22-a559-68e7b0fe6bbd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1226 microversion: 2.1 time: 0.169441 Sep 08 14:00:09.779877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 19/36] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:09 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1226 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:09.825445 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b59ed3f3-93a0-4c9f-835e-6f5fa2956e0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:09.826775 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b59ed3f3-93a0-4c9f-835e-6f5fa2956e0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:09.832004 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] validate_networks() for [('38509184-249f-4b78-9ab0-339bc3caa638', None, None, None, None, None)] {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:00:09.833904 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b59ed3f3-93a0-4c9f-835e-6f5fa2956e0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:09.834396 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b59ed3f3-93a0-4c9f-835e-6f5fa2956e0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:09.834860 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b59ed3f3-93a0-4c9f-835e-6f5fa2956e0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:09.835594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b59ed3f3-93a0-4c9f-835e-6f5fa2956e0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:09.836109 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b59ed3f3-93a0-4c9f-835e-6f5fa2956e0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:09.836524 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b59ed3f3-93a0-4c9f-835e-6f5fa2956e0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:09.954677 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b59ed3f3-93a0-4c9f-835e-6f5fa2956e0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:09.964376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b59ed3f3-93a0-4c9f-835e-6f5fa2956e0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1290 microversion: 2.1 time: 0.143641 Sep 08 14:00:09.971418 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 20/37] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:09 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1290 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:10.124294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c51acd1d-a78c-4d8c-921c-4a9e909f4f12 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:10.125033 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c51acd1d-a78c-4d8c-921c-4a9e909f4f12 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:10.150207 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51acd1d-a78c-4d8c-921c-4a9e909f4f12 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.153055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51acd1d-a78c-4d8c-921c-4a9e909f4f12 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.155451 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51acd1d-a78c-4d8c-921c-4a9e909f4f12 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.156381 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51acd1d-a78c-4d8c-921c-4a9e909f4f12 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.157125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51acd1d-a78c-4d8c-921c-4a9e909f4f12 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.157574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51acd1d-a78c-4d8c-921c-4a9e909f4f12 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.686111 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c51acd1d-a78c-4d8c-921c-4a9e909f4f12 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:10.732364 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:00:10.733167 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:00:10.733417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:00:10.733829 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:00:10.734244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:00:10.741100 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c51acd1d-a78c-4d8c-921c-4a9e909f4f12 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1211 microversion: 2.1 time: 0.622788 Sep 08 14:00:10.742017 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 21/38] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:10 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1211 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:10.776526 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.777003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.777660 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.778704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.779342 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.779978 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.809241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-229da97d-6802-4348-a698-3cfafa9b54e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:10.809937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-229da97d-6802-4348-a698-3cfafa9b54e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:10.821482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-229da97d-6802-4348-a698-3cfafa9b54e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.821980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-229da97d-6802-4348-a698-3cfafa9b54e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.825255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-229da97d-6802-4348-a698-3cfafa9b54e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.826632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-229da97d-6802-4348-a698-3cfafa9b54e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.827215 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:00:10.837482 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for user beb41eb66e8140a6999b0bddab3c4afd and project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:00:10.858433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-229da97d-6802-4348-a698-3cfafa9b54e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.858765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-229da97d-6802-4348-a698-3cfafa9b54e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.885797 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:00:10.893995 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:00:11.152823 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-912156ec-2ec8-459a-8a3f-f4cfb761b336 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.517682 Sep 08 14:00:11.153908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 18/39] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:00:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:00:11.183801 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-845209bd-1fc0-4efa-8d89-f0f9609c2ce6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:11.184641 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-845209bd-1fc0-4efa-8d89-f0f9609c2ce6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:11.212243 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-845209bd-1fc0-4efa-8d89-f0f9609c2ce6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:11.220908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-845209bd-1fc0-4efa-8d89-f0f9609c2ce6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:11.221810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-845209bd-1fc0-4efa-8d89-f0f9609c2ce6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:11.228067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-845209bd-1fc0-4efa-8d89-f0f9609c2ce6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:11.228787 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-845209bd-1fc0-4efa-8d89-f0f9609c2ce6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:11.230396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-845209bd-1fc0-4efa-8d89-f0f9609c2ce6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:11.589532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-845209bd-1fc0-4efa-8d89-f0f9609c2ce6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:11.619302 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-845209bd-1fc0-4efa-8d89-f0f9609c2ce6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1298 microversion: 2.1 time: 0.454639 Sep 08 14:00:11.621452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 19/40] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:11 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1298 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:11.736473 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-229da97d-6802-4348-a698-3cfafa9b54e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:11.753947 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-229da97d-6802-4348-a698-3cfafa9b54e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1218 microversion: 2.1 time: 0.952657 Sep 08 14:00:11.754801 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 22/41] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:10 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1218 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:11.805682 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-bc07d34e-fcb9-48f1-af75-8f4f0e279bd4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:11.812439 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-bc07d34e-fcb9-48f1-af75-8f4f0e279bd4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:12.085813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-65f7ad5a-5360-47a1-aebd-cc0a5caf83c0 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Action: 'create', calling method: .version_select at 0x7f5200423d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-577224971", "metadata": {"Type": "work"}}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-65f7ad5a-5360-47a1-aebd-cc0a5caf83c0 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Request method failure captured: Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 121 Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVquHK3UPh7FOtzbTWZUjiCZXzIiBcp_v8dgFEvCDwH0nUvB3heLJw8-nwrPxuxOvJW5KrGZOIh5gTbc38KO9f10OaSH4dbCMUsN-L5kEvv8PqUVzM6elwQ25s7xrOVdpl3OjMbtAZY7tZuCzEMcALY-jXKMwi19XCp2Vq2UsDPAHI Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:00:12.096860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_5d20f4ba94804b3a9de1dfa49e34126c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 9ea4e41ed5b84be0be8e226b06953dd3 Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-577224971", "metadata": {"Type": "work"}}} Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: Sep 08 14:00:12.098122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-577224971', 'metadata': {'Type': 'work'}}}} Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise error Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi '#$%' Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:12.098969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 14:00:12.100420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 14:00:12.101674 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 14:00:12.101674 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.101674 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-65f7ad5a-5360-47a1-aebd-cc0a5caf83c0 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:12.101674 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-65f7ad5a-5360-47a1-aebd-cc0a5caf83c0 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.474795 Sep 08 14:00:12.106018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 20/42] 10.222.0.91 () {60 vars in 1156 bytes} [Thu Sep 8 14:00:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 482 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:00:12.114085 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2b209058-dc9e-4d81-a950-1910dd05854a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:12.117702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2b209058-dc9e-4d81-a950-1910dd05854a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:12.128257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b209058-dc9e-4d81-a950-1910dd05854a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:12.130029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b209058-dc9e-4d81-a950-1910dd05854a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:12.130856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b209058-dc9e-4d81-a950-1910dd05854a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:12.132296 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b209058-dc9e-4d81-a950-1910dd05854a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:12.133790 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b209058-dc9e-4d81-a950-1910dd05854a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:12.134526 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b209058-dc9e-4d81-a950-1910dd05854a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:12.261374 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2b209058-dc9e-4d81-a950-1910dd05854a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:12.281043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2b209058-dc9e-4d81-a950-1910dd05854a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1267 microversion: 2.1 time: 0.174973 Sep 08 14:00:12.285177 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 21/43] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:12 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:12.290379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-bc07d34e-fcb9-48f1-af75-8f4f0e279bd4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:12.308402 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-bc07d34e-fcb9-48f1-af75-8f4f0e279bd4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1242 microversion: 2.1 time: 0.544044 Sep 08 14:00:12.313060 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b7044698-d320-4066-ad77-3a2346b8c539 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Action: 'create', calling method: .version_select at 0x7f5200423e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1261023639", "metadata": {"Type": "work"}}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:12.314452 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 23/44] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:11 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1242 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b7044698-d320-4066-ad77-3a2346b8c539 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Request method failure captured: Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 120 Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVquHK3UPh7FOtzbTWZUjiCZXzIiBcp_v8dgFEvCDwH0nUvB3heLJw8-nwrPxuxOvJW5KrGZOIh5gTbc38KO9f10OaSH4dbCMUsN-L5kEvv8PqUVzM6elwQ25s7xrOVdpl3OjMbtAZY7tZuCzEMcALY-jXKMwi19XCp2Vq2UsDPAHI Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:00:12.330525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_5d20f4ba94804b3a9de1dfa49e34126c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 9ea4e41ed5b84be0be8e226b06953dd3 Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1261023639", "metadata": {"Type": "work"}}} Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: Sep 08 14:00:12.332381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1261023639', 'metadata': {'Type': 'work'}}}} Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise error Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi '0' Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:12.333793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 14:00:12.336346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 14:00:12.338318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 14:00:12.338318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.356111 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b7044698-d320-4066-ad77-3a2346b8c539 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:12.357211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b7044698-d320-4066-ad77-3a2346b8c539 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.069806 Sep 08 14:00:12.359220 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 22/45] 10.222.0.91 () {60 vars in 1156 bytes} [Thu Sep 8 14:00:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:00:12.371920 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4266d295-f1a5-4164-8022-cda9d1be44ab tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Action: 'create', calling method: .version_select at 0x7f5200403dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1497048628", "metadata": {"Type": "work"}}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4266d295-f1a5-4164-8022-cda9d1be44ab tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Request method failure captured: Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 119 Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVquHK3UPh7FOtzbTWZUjiCZXzIiBcp_v8dgFEvCDwH0nUvB3heLJw8-nwrPxuxOvJW5KrGZOIh5gTbc38KO9f10OaSH4dbCMUsN-L5kEvv8PqUVzM6elwQ25s7xrOVdpl3OjMbtAZY7tZuCzEMcALY-jXKMwi19XCp2Vq2UsDPAHI Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:00:12.390823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_5d20f4ba94804b3a9de1dfa49e34126c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 9ea4e41ed5b84be0be8e226b06953dd3 Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1497048628", "metadata": {"Type": "work"}}} Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: Sep 08 14:00:12.392148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1497048628', 'metadata': {'Type': 'work'}}}} Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise error Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi '' Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:12.392926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 14:00:12.394221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 14:00:12.395343 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 14:00:12.395343 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.399416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4266d295-f1a5-4164-8022-cda9d1be44ab tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:12.403827 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4266d295-f1a5-4164-8022-cda9d1be44ab tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.036852 Sep 08 14:00:12.404969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 24/46] 10.222.0.91 () {60 vars in 1156 bytes} [Thu Sep 8 14:00:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:00:12.419251 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-50d29ebd-94e7-4ecc-bb23-b47fbdc09dd8 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Calling method '.version_select at 0x7f5200360430>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:12.475331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-50d29ebd-94e7-4ecc-bb23-b47fbdc09dd8 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] HTTP exception thrown: Volume tempest-invalid-792452968 could not be found. Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-50d29ebd-94e7-4ecc-bb23-b47fbdc09dd8 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Request method failure captured: Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-792452968 HTTP/1.1 Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVquHK3UPh7FOtzbTWZUjiCZXzIiBcp_v8dgFEvCDwH0nUvB3heLJw8-nwrPxuxOvJW5KrGZOIh5gTbc38KO9f10OaSH4dbCMUsN-L5kEvv8PqUVzM6elwQ25s7xrOVdpl3OjMbtAZY7tZuCzEMcALY-jXKMwi19XCp2Vq2UsDPAHI Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:00:12.480192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_5d20f4ba94804b3a9de1dfa49e34126c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 9ea4e41ed5b84be0be8e226b06953dd3 Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Volume tempest-invalid-792452968 could not be found. Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'tempest-invalid-792452968'} Sep 08 14:00:12.481464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-792452968 could not be found. (HTTP 404) (Request-ID: req-efc21828-a186-4c4f-9efd-33cb67b0f618) Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.482225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:00:12.483278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-792452968 could not be found. Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:12.484327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-792452968 could not be found. Sep 08 14:00:12.485612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.485612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.485612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.485612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.485612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.485612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.485612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:12.485612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:12.485612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-792452968 could not be found. Sep 08 14:00:12.485612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.488034 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-50d29ebd-94e7-4ecc-bb23-b47fbdc09dd8 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Returning 404 to user: Volume tempest-invalid-792452968 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:12.489873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-50d29ebd-94e7-4ecc-bb23-b47fbdc09dd8 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/tempest-invalid-792452968" status: 404 len: 98 microversion: 2.1 time: 0.075788 Sep 08 14:00:12.490648 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 23/47] 10.222.0.91 () {58 vars in 1215 bytes} [Thu Sep 8 14:00:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-792452968 => generated 98 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 14:00:12.504305 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b6b3986c-8f78-432e-8bc7-5706fba8b105 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006218 Sep 08 14:00:12.505310 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 25/48] 10.222.0.91 () {58 vars in 1140 bytes} [Thu Sep 8 14:00:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 14:00:12.523664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3f9140a5-6ad3-4c1b-8d1b-a4f40324d5bf tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011586 Sep 08 14:00:12.525467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 24/49] 10.222.0.91 () {58 vars in 1137 bytes} [Thu Sep 8 14:00:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 14:00:12.543175 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-920d2ea6-2c25-4149-a322-7e6de431e95d tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Calling method '.version_select at 0x7f52003a1430>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:12.594335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-920d2ea6-2c25-4149-a322-7e6de431e95d tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] HTTP exception thrown: Volume 99f7f3e9-4f16-400a-9980-dd3920bb7dd9 could not be found. Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-920d2ea6-2c25-4149-a322-7e6de431e95d tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Request method failure captured: Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: DELETE /compute/v2.1/os-volumes/99f7f3e9-4f16-400a-9980-dd3920bb7dd9 HTTP/1.1 Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVquHK3UPh7FOtzbTWZUjiCZXzIiBcp_v8dgFEvCDwH0nUvB3heLJw8-nwrPxuxOvJW5KrGZOIh5gTbc38KO9f10OaSH4dbCMUsN-L5kEvv8PqUVzM6elwQ25s7xrOVdpl3OjMbtAZY7tZuCzEMcALY-jXKMwi19XCp2Vq2UsDPAHI Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:00:12.596421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_5d20f4ba94804b3a9de1dfa49e34126c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 9ea4e41ed5b84be0be8e226b06953dd3 Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Volume 99f7f3e9-4f16-400a-9980-dd3920bb7dd9 could not be found. Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '99f7f3e9-4f16-400a-9980-dd3920bb7dd9'} Sep 08 14:00:12.597574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99f7f3e9-4f16-400a-9980-dd3920bb7dd9 could not be found. (HTTP 404) (Request-ID: req-5f7eac52-b8c1-4bd3-80bf-f7426aefca51) Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.598239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:00:12.599836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99f7f3e9-4f16-400a-9980-dd3920bb7dd9 could not be found. Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 14:00:12.600752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99f7f3e9-4f16-400a-9980-dd3920bb7dd9 could not be found. Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99f7f3e9-4f16-400a-9980-dd3920bb7dd9 could not be found. Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-920d2ea6-2c25-4149-a322-7e6de431e95d tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Returning 404 to user: Volume 99f7f3e9-4f16-400a-9980-dd3920bb7dd9 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:12.602538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-920d2ea6-2c25-4149-a322-7e6de431e95d tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/99f7f3e9-4f16-400a-9980-dd3920bb7dd9" status: 404 len: 109 microversion: 2.1 time: 0.065902 Sep 08 14:00:12.609669 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4fce5868-089a-4be4-8ebc-6fd8f7ea9956 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Calling method '.version_select at 0x7f5200360a60>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:12.627799 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 26/50] 10.222.0.91 () {58 vars in 1248 bytes} [Thu Sep 8 14:00:12 2022] DELETE /compute/v2.1/os-volumes/99f7f3e9-4f16-400a-9980-dd3920bb7dd9 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:12.661392 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-cecfd314-ff1f-41c6-b0f6-9bc84f1695e2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:12.662570 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-cecfd314-ff1f-41c6-b0f6-9bc84f1695e2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:12.672621 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cecfd314-ff1f-41c6-b0f6-9bc84f1695e2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:12.673637 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cecfd314-ff1f-41c6-b0f6-9bc84f1695e2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:12.675447 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cecfd314-ff1f-41c6-b0f6-9bc84f1695e2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:12.676738 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cecfd314-ff1f-41c6-b0f6-9bc84f1695e2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:12.677916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cecfd314-ff1f-41c6-b0f6-9bc84f1695e2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:12.678659 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cecfd314-ff1f-41c6-b0f6-9bc84f1695e2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:12.730052 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-4fce5868-089a-4be4-8ebc-6fd8f7ea9956 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] HTTP exception thrown: Volume 9856ae5c-eb8f-4ed7-b336-175051a3a9ac could not be found. Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4fce5868-089a-4be4-8ebc-6fd8f7ea9956 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Request method failure captured: Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/os-volumes/9856ae5c-eb8f-4ed7-b336-175051a3a9ac HTTP/1.1 Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVquHK3UPh7FOtzbTWZUjiCZXzIiBcp_v8dgFEvCDwH0nUvB3heLJw8-nwrPxuxOvJW5KrGZOIh5gTbc38KO9f10OaSH4dbCMUsN-L5kEvv8PqUVzM6elwQ25s7xrOVdpl3OjMbtAZY7tZuCzEMcALY-jXKMwi19XCp2Vq2UsDPAHI Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:00:12.732871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_5d20f4ba94804b3a9de1dfa49e34126c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/5d20f4ba94804b3a9de1dfa49e34126c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 5d20f4ba94804b3a9de1dfa49e34126c Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-VolumesNegativeTest-612557469 Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 9ea4e41ed5b84be0be8e226b06953dd3 Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-VolumesNegativeTest-612557469-project Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Volume 9856ae5c-eb8f-4ed7-b336-175051a3a9ac could not be found. Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '9856ae5c-eb8f-4ed7-b336-175051a3a9ac'} Sep 08 14:00:12.733996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9856ae5c-eb8f-4ed7-b336-175051a3a9ac could not be found. (HTTP 404) (Request-ID: req-cf779f01-bc91-4de1-b801-8db1ebdd81ce) Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.734650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:00:12.735639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9856ae5c-eb8f-4ed7-b336-175051a3a9ac could not be found. Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 14:00:12.736628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9856ae5c-eb8f-4ed7-b336-175051a3a9ac could not be found. Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9856ae5c-eb8f-4ed7-b336-175051a3a9ac could not be found. Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4fce5868-089a-4be4-8ebc-6fd8f7ea9956 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] Returning 404 to user: Volume 9856ae5c-eb8f-4ed7-b336-175051a3a9ac could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4fce5868-089a-4be4-8ebc-6fd8f7ea9956 tempest-VolumesNegativeTest-612557469 tempest-VolumesNegativeTest-612557469-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/9856ae5c-eb8f-4ed7-b336-175051a3a9ac" status: 404 len: 109 microversion: 2.1 time: 0.128545 Sep 08 14:00:12.737540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 25/51] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 14:00:12 2022] GET /compute/v2.1/os-volumes/9856ae5c-eb8f-4ed7-b336-175051a3a9ac => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:00:12.786087 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8993e25d-ef0b-42b7-bb44-77c46a0ca501 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:12.786848 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8993e25d-ef0b-42b7-bb44-77c46a0ca501 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:12.788933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:12.805048 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8993e25d-ef0b-42b7-bb44-77c46a0ca501 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:12.808325 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8993e25d-ef0b-42b7-bb44-77c46a0ca501 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:12.817599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8993e25d-ef0b-42b7-bb44-77c46a0ca501 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:12.817599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8993e25d-ef0b-42b7-bb44-77c46a0ca501 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:12.817599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8993e25d-ef0b-42b7-bb44-77c46a0ca501 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:12.817599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8993e25d-ef0b-42b7-bb44-77c46a0ca501 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:12.976379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-cecfd314-ff1f-41c6-b0f6-9bc84f1695e2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:13.004055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-cecfd314-ff1f-41c6-b0f6-9bc84f1695e2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1296 microversion: 2.1 time: 0.349057 Sep 08 14:00:13.006861 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 27/52] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:12 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1296 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:13.304923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8993e25d-ef0b-42b7-bb44-77c46a0ca501 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:13.316936 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-273497d6-cd00-40e2-b0b4-dff4ed4737a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:13.318528 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-273497d6-cd00-40e2-b0b4-dff4ed4737a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:13.347335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-273497d6-cd00-40e2-b0b4-dff4ed4737a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:13.350361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8993e25d-ef0b-42b7-bb44-77c46a0ca501 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1274 microversion: 2.1 time: 0.564883 Sep 08 14:00:13.353259 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-273497d6-cd00-40e2-b0b4-dff4ed4737a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:13.353829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-273497d6-cd00-40e2-b0b4-dff4ed4737a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:13.354795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 26/53] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:12 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1274 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:13.366829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-273497d6-cd00-40e2-b0b4-dff4ed4737a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:13.374133 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-273497d6-cd00-40e2-b0b4-dff4ed4737a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:13.375005 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-273497d6-cd00-40e2-b0b4-dff4ed4737a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:13.381411 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-866b9699-dcb5-42c6-9229-0ee701ce14f8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:13.383853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-866b9699-dcb5-42c6-9229-0ee701ce14f8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:13.611189 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-866b9699-dcb5-42c6-9229-0ee701ce14f8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:13.620633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-866b9699-dcb5-42c6-9229-0ee701ce14f8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1242 microversion: 2.1 time: 0.261805 Sep 08 14:00:13.626212 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 27/54] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:13 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1242 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:13.812636 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-273497d6-cd00-40e2-b0b4-dff4ed4737a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:13.829190 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-273497d6-cd00-40e2-b0b4-dff4ed4737a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1275 microversion: 2.1 time: 0.511699 Sep 08 14:00:13.831083 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 28/55] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:13 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1275 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:14.049917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5c181a9d-6b5c-4c04-a430-1925f50ae2b6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:14.049917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5c181a9d-6b5c-4c04-a430-1925f50ae2b6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:14.049917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c181a9d-6b5c-4c04-a430-1925f50ae2b6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:14.049917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c181a9d-6b5c-4c04-a430-1925f50ae2b6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:14.050442 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c181a9d-6b5c-4c04-a430-1925f50ae2b6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:14.050442 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c181a9d-6b5c-4c04-a430-1925f50ae2b6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:14.060760 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c181a9d-6b5c-4c04-a430-1925f50ae2b6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:14.061386 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c181a9d-6b5c-4c04-a430-1925f50ae2b6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:14.352142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5c181a9d-6b5c-4c04-a430-1925f50ae2b6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:14.366728 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5c181a9d-6b5c-4c04-a430-1925f50ae2b6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1296 microversion: 2.1 time: 0.334796 Sep 08 14:00:14.368305 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 28/56] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:14 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1296 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:14.383744 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-41aa3d92-a60f-4f51-96cd-0d46346ec03b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:14.384595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-41aa3d92-a60f-4f51-96cd-0d46346ec03b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:14.404879 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41aa3d92-a60f-4f51-96cd-0d46346ec03b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:14.405383 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41aa3d92-a60f-4f51-96cd-0d46346ec03b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:14.405817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41aa3d92-a60f-4f51-96cd-0d46346ec03b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:14.406563 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41aa3d92-a60f-4f51-96cd-0d46346ec03b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:14.407047 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41aa3d92-a60f-4f51-96cd-0d46346ec03b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:14.407461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41aa3d92-a60f-4f51-96cd-0d46346ec03b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:14.585695 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-41aa3d92-a60f-4f51-96cd-0d46346ec03b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:14.598800 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-41aa3d92-a60f-4f51-96cd-0d46346ec03b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1274 microversion: 2.1 time: 0.226315 Sep 08 14:00:14.614863 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 29/57] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:14 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:14.665683 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0c5f33c5-83cb-4a7e-a4bb-8efdd1a777da tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:14.666332 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0c5f33c5-83cb-4a7e-a4bb-8efdd1a777da tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:14.686532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0c5f33c5-83cb-4a7e-a4bb-8efdd1a777da tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:14.689262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0c5f33c5-83cb-4a7e-a4bb-8efdd1a777da tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:14.690190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0c5f33c5-83cb-4a7e-a4bb-8efdd1a777da tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:14.692459 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0c5f33c5-83cb-4a7e-a4bb-8efdd1a777da tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:14.696205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0c5f33c5-83cb-4a7e-a4bb-8efdd1a777da tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:14.696924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0c5f33c5-83cb-4a7e-a4bb-8efdd1a777da tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:14.863703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ffdaf0fa-0a05-4c3c-ac6b-41387d8fd3a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:14.864902 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ffdaf0fa-0a05-4c3c-ac6b-41387d8fd3a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:14.878701 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ffdaf0fa-0a05-4c3c-ac6b-41387d8fd3a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:14.879710 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ffdaf0fa-0a05-4c3c-ac6b-41387d8fd3a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:14.880388 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ffdaf0fa-0a05-4c3c-ac6b-41387d8fd3a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:14.882282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ffdaf0fa-0a05-4c3c-ac6b-41387d8fd3a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:14.883266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ffdaf0fa-0a05-4c3c-ac6b-41387d8fd3a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:14.883979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ffdaf0fa-0a05-4c3c-ac6b-41387d8fd3a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:15.017541 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0c5f33c5-83cb-4a7e-a4bb-8efdd1a777da tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:15.050787 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0c5f33c5-83cb-4a7e-a4bb-8efdd1a777da tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1246 microversion: 2.1 time: 0.389274 Sep 08 14:00:15.054446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 29/58] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:14 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1246 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:15.250485 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ffdaf0fa-0a05-4c3c-ac6b-41387d8fd3a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:15.263426 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ffdaf0fa-0a05-4c3c-ac6b-41387d8fd3a1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1273 microversion: 2.1 time: 0.401202 Sep 08 14:00:15.282073 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 30/59] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:14 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1273 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:15.404121 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3b96c45d-e10b-4c32-9fae-89d1d8cb4cb7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:15.406032 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3b96c45d-e10b-4c32-9fae-89d1d8cb4cb7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:15.422845 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b96c45d-e10b-4c32-9fae-89d1d8cb4cb7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:15.423370 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b96c45d-e10b-4c32-9fae-89d1d8cb4cb7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:15.431474 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b96c45d-e10b-4c32-9fae-89d1d8cb4cb7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:15.433498 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b96c45d-e10b-4c32-9fae-89d1d8cb4cb7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:15.436861 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b96c45d-e10b-4c32-9fae-89d1d8cb4cb7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:15.437743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b96c45d-e10b-4c32-9fae-89d1d8cb4cb7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:15.645880 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-bfe15a7a-3cda-493a-ab44-e7fa182739bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:15.650333 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-bfe15a7a-3cda-493a-ab44-e7fa182739bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:15.666782 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bfe15a7a-3cda-493a-ab44-e7fa182739bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:15.673321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bfe15a7a-3cda-493a-ab44-e7fa182739bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:15.678202 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bfe15a7a-3cda-493a-ab44-e7fa182739bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:15.679136 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bfe15a7a-3cda-493a-ab44-e7fa182739bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:15.679700 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bfe15a7a-3cda-493a-ab44-e7fa182739bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:15.680745 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bfe15a7a-3cda-493a-ab44-e7fa182739bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:15.883330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-bfe15a7a-3cda-493a-ab44-e7fa182739bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:15.895336 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-bfe15a7a-3cda-493a-ab44-e7fa182739bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1280 microversion: 2.1 time: 0.254336 Sep 08 14:00:15.911685 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 31/60] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:15 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1280 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:16.088668 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-16929ec5-5f72-4b84-a755-789a34a9d980 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:16.090410 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-16929ec5-5f72-4b84-a755-789a34a9d980 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:16.106536 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16929ec5-5f72-4b84-a755-789a34a9d980 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:16.112573 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16929ec5-5f72-4b84-a755-789a34a9d980 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:16.112573 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16929ec5-5f72-4b84-a755-789a34a9d980 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:16.112573 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16929ec5-5f72-4b84-a755-789a34a9d980 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:16.112573 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16929ec5-5f72-4b84-a755-789a34a9d980 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:16.113097 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16929ec5-5f72-4b84-a755-789a34a9d980 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:16.199575 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3b96c45d-e10b-4c32-9fae-89d1d8cb4cb7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:16.221273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3b96c45d-e10b-4c32-9fae-89d1d8cb4cb7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.822535 Sep 08 14:00:16.222413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 30/61] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:15 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:16.290634 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-16929ec5-5f72-4b84-a755-789a34a9d980 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:16.299290 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-16929ec5-5f72-4b84-a755-789a34a9d980 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1294 microversion: 2.1 time: 0.220020 Sep 08 14:00:16.304850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 32/62] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:16 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1294 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:16.318469 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-34be5c8b-5f5f-456d-8c1c-5e963e271c13 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:16.319194 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-34be5c8b-5f5f-456d-8c1c-5e963e271c13 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:16.336401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34be5c8b-5f5f-456d-8c1c-5e963e271c13 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:16.336401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34be5c8b-5f5f-456d-8c1c-5e963e271c13 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:16.336401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34be5c8b-5f5f-456d-8c1c-5e963e271c13 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:16.336401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34be5c8b-5f5f-456d-8c1c-5e963e271c13 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:16.337543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34be5c8b-5f5f-456d-8c1c-5e963e271c13 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:16.337543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34be5c8b-5f5f-456d-8c1c-5e963e271c13 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:16.938725 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9d783bcb-83f0-40ab-a359-dca58bb95027 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:16.939428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9d783bcb-83f0-40ab-a359-dca58bb95027 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:16.957228 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=4 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:16.979679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d783bcb-83f0-40ab-a359-dca58bb95027 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:16.980287 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d783bcb-83f0-40ab-a359-dca58bb95027 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:16.985668 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d783bcb-83f0-40ab-a359-dca58bb95027 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:16.986789 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d783bcb-83f0-40ab-a359-dca58bb95027 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:16.989707 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d783bcb-83f0-40ab-a359-dca58bb95027 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:16.991615 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d783bcb-83f0-40ab-a359-dca58bb95027 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:17.089348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-34be5c8b-5f5f-456d-8c1c-5e963e271c13 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:17.107170 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-34be5c8b-5f5f-456d-8c1c-5e963e271c13 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.792389 Sep 08 14:00:17.108177 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 31/63] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:16 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:17.245560 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c8d71fca-ca3b-487f-8cfc-87282fa07dea tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:17.246278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c8d71fca-ca3b-487f-8cfc-87282fa07dea tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:17.268163 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8d71fca-ca3b-487f-8cfc-87282fa07dea tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:17.268163 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8d71fca-ca3b-487f-8cfc-87282fa07dea tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:17.271299 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8d71fca-ca3b-487f-8cfc-87282fa07dea tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:17.272335 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8d71fca-ca3b-487f-8cfc-87282fa07dea tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:17.272957 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8d71fca-ca3b-487f-8cfc-87282fa07dea tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:17.273534 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8d71fca-ca3b-487f-8cfc-87282fa07dea tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:17.592943 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9d783bcb-83f0-40ab-a359-dca58bb95027 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:17.607217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9d783bcb-83f0-40ab-a359-dca58bb95027 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1280 microversion: 2.1 time: 0.682819 Sep 08 14:00:17.607803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 33/64] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:16 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1280 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:17.625519 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1c2a93d1-7509-4800-9f1f-1ceea9a0ae9d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:17.639900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1c2a93d1-7509-4800-9f1f-1ceea9a0ae9d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:17.660044 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1c2a93d1-7509-4800-9f1f-1ceea9a0ae9d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:17.660545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1c2a93d1-7509-4800-9f1f-1ceea9a0ae9d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:17.660983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1c2a93d1-7509-4800-9f1f-1ceea9a0ae9d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:17.661695 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1c2a93d1-7509-4800-9f1f-1ceea9a0ae9d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:17.665275 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1c2a93d1-7509-4800-9f1f-1ceea9a0ae9d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:17.665723 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1c2a93d1-7509-4800-9f1f-1ceea9a0ae9d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:17.923096 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1c2a93d1-7509-4800-9f1f-1ceea9a0ae9d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:17.937300 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1c2a93d1-7509-4800-9f1f-1ceea9a0ae9d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1312 microversion: 2.1 time: 0.322582 Sep 08 14:00:17.938985 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 34/65] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:17 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1312 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:18.038250 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c8d71fca-ca3b-487f-8cfc-87282fa07dea tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:18.050199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c8d71fca-ca3b-487f-8cfc-87282fa07dea tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.808434 Sep 08 14:00:18.050795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 32/66] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:17 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:18.135013 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a3f0c7ad-6cc7-4ca3-90ab-9497e776a3b0 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:18.136986 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a3f0c7ad-6cc7-4ca3-90ab-9497e776a3b0 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:18.149019 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a3f0c7ad-6cc7-4ca3-90ab-9497e776a3b0 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:18.150091 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a3f0c7ad-6cc7-4ca3-90ab-9497e776a3b0 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:18.151428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a3f0c7ad-6cc7-4ca3-90ab-9497e776a3b0 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:18.152787 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a3f0c7ad-6cc7-4ca3-90ab-9497e776a3b0 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:18.153778 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a3f0c7ad-6cc7-4ca3-90ab-9497e776a3b0 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:18.154675 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a3f0c7ad-6cc7-4ca3-90ab-9497e776a3b0 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:18.383774 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a3f0c7ad-6cc7-4ca3-90ab-9497e776a3b0 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:18.400489 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a3f0c7ad-6cc7-4ca3-90ab-9497e776a3b0 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.271919 Sep 08 14:00:18.402635 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 35/67] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:18 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:18.644037 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fd2d05c8-4e39-4f57-864e-cbe37ad44652 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:18.647037 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-fd2d05c8-4e39-4f57-864e-cbe37ad44652 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:18.661203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd2d05c8-4e39-4f57-864e-cbe37ad44652 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:18.664273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd2d05c8-4e39-4f57-864e-cbe37ad44652 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:18.664443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd2d05c8-4e39-4f57-864e-cbe37ad44652 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:18.665486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd2d05c8-4e39-4f57-864e-cbe37ad44652 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:18.666267 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd2d05c8-4e39-4f57-864e-cbe37ad44652 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:18.667753 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd2d05c8-4e39-4f57-864e-cbe37ad44652 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:18.782024 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-fd2d05c8-4e39-4f57-864e-cbe37ad44652 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:18.801723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-fd2d05c8-4e39-4f57-864e-cbe37ad44652 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1280 microversion: 2.1 time: 0.170730 Sep 08 14:00:18.806525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 33/68] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:18 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:18.970637 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5969c926-bb78-4c4d-be31-672b2e64a5e5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:18.972152 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5969c926-bb78-4c4d-be31-672b2e64a5e5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:18.981169 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5969c926-bb78-4c4d-be31-672b2e64a5e5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:18.982408 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5969c926-bb78-4c4d-be31-672b2e64a5e5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:18.983349 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5969c926-bb78-4c4d-be31-672b2e64a5e5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:18.984274 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5969c926-bb78-4c4d-be31-672b2e64a5e5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:18.984959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5969c926-bb78-4c4d-be31-672b2e64a5e5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:18.985599 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5969c926-bb78-4c4d-be31-672b2e64a5e5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.072985 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5969c926-bb78-4c4d-be31-672b2e64a5e5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:19.074322 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5969c926-bb78-4c4d-be31-672b2e64a5e5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1300 microversion: 2.1 time: 0.110579 Sep 08 14:00:19.083915 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2cd045c0-1fe7-44ab-918c-56b7bdcaf318 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:19.085197 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2cd045c0-1fe7-44ab-918c-56b7bdcaf318 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:19.087789 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 36/69] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:18 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:19.096997 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2cd045c0-1fe7-44ab-918c-56b7bdcaf318 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:19.098022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2cd045c0-1fe7-44ab-918c-56b7bdcaf318 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:19.098682 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2cd045c0-1fe7-44ab-918c-56b7bdcaf318 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.099690 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2cd045c0-1fe7-44ab-918c-56b7bdcaf318 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:19.100307 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2cd045c0-1fe7-44ab-918c-56b7bdcaf318 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:19.100972 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2cd045c0-1fe7-44ab-918c-56b7bdcaf318 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.431863 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-365feecf-c1a4-41f5-b850-e68ba7a24390 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:19.433193 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-365feecf-c1a4-41f5-b850-e68ba7a24390 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:19.446840 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-365feecf-c1a4-41f5-b850-e68ba7a24390 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:19.448319 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-365feecf-c1a4-41f5-b850-e68ba7a24390 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:19.449460 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-365feecf-c1a4-41f5-b850-e68ba7a24390 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.451215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-365feecf-c1a4-41f5-b850-e68ba7a24390 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:19.459430 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-365feecf-c1a4-41f5-b850-e68ba7a24390 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:19.461061 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-365feecf-c1a4-41f5-b850-e68ba7a24390 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.853512 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2cd045c0-1fe7-44ab-918c-56b7bdcaf318 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:19.858158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2cd045c0-1fe7-44ab-918c-56b7bdcaf318 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.778762 Sep 08 14:00:19.859115 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 34/70] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:19 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:19.868000 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-73b8f3d2-4ab1-4394-8406-44b276480a67 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:19.869302 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-73b8f3d2-4ab1-4394-8406-44b276480a67 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:19.892741 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-73b8f3d2-4ab1-4394-8406-44b276480a67 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:19.893855 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-73b8f3d2-4ab1-4394-8406-44b276480a67 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:19.894805 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-73b8f3d2-4ab1-4394-8406-44b276480a67 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.896144 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-73b8f3d2-4ab1-4394-8406-44b276480a67 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:19.897171 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-73b8f3d2-4ab1-4394-8406-44b276480a67 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:19.897985 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-73b8f3d2-4ab1-4394-8406-44b276480a67 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.997510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-365feecf-c1a4-41f5-b850-e68ba7a24390 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:20.002603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=100 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:20.008578 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-365feecf-c1a4-41f5-b850-e68ba7a24390 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.585213 Sep 08 14:00:20.009931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 37/71] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:19 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:20.106234 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3829fd50-1e24-4d45-addc-6ef1ea0128ee tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:20.108614 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3829fd50-1e24-4d45-addc-6ef1ea0128ee tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:20.127884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3829fd50-1e24-4d45-addc-6ef1ea0128ee tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:20.128870 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3829fd50-1e24-4d45-addc-6ef1ea0128ee tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:20.132070 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3829fd50-1e24-4d45-addc-6ef1ea0128ee tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:20.135616 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3829fd50-1e24-4d45-addc-6ef1ea0128ee tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:20.136909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3829fd50-1e24-4d45-addc-6ef1ea0128ee tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:20.154151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3829fd50-1e24-4d45-addc-6ef1ea0128ee tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:20.306178 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-73b8f3d2-4ab1-4394-8406-44b276480a67 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:20.344414 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-73b8f3d2-4ab1-4394-8406-44b276480a67 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1280 microversion: 2.1 time: 0.455335 Sep 08 14:00:20.362956 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 35/72] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:19 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1280 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:20.512410 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3829fd50-1e24-4d45-addc-6ef1ea0128ee tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:20.544434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3829fd50-1e24-4d45-addc-6ef1ea0128ee tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1300 microversion: 2.1 time: 0.445692 Sep 08 14:00:20.550462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 38/73] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:20 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1300 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:20.895348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7e64be08-9c71-4091-8151-f2dba67a7fae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:20.895769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7e64be08-9c71-4091-8151-f2dba67a7fae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:20.897704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=6 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:20.907139 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e64be08-9c71-4091-8151-f2dba67a7fae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:20.907665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e64be08-9c71-4091-8151-f2dba67a7fae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:20.908248 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e64be08-9c71-4091-8151-f2dba67a7fae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:20.909808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e64be08-9c71-4091-8151-f2dba67a7fae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:20.910203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e64be08-9c71-4091-8151-f2dba67a7fae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:20.911786 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e64be08-9c71-4091-8151-f2dba67a7fae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:21.037482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-171203af-0ceb-4113-974c-3f4b20803843 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:21.038291 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-171203af-0ceb-4113-974c-3f4b20803843 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:21.041688 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:21.055442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-171203af-0ceb-4113-974c-3f4b20803843 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:21.065380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-171203af-0ceb-4113-974c-3f4b20803843 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:21.065985 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-171203af-0ceb-4113-974c-3f4b20803843 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:21.066774 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-171203af-0ceb-4113-974c-3f4b20803843 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:21.067286 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-171203af-0ceb-4113-974c-3f4b20803843 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:21.067754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-171203af-0ceb-4113-974c-3f4b20803843 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:22.296602 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=26 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:22.336490 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7e64be08-9c71-4091-8151-f2dba67a7fae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:22.351723 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-171203af-0ceb-4113-974c-3f4b20803843 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:22.356126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7e64be08-9c71-4091-8151-f2dba67a7fae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 1.463121 Sep 08 14:00:22.357293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 36/74] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:20 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:22.361448 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-171203af-0ceb-4113-974c-3f4b20803843 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 1.328125 Sep 08 14:00:22.370234 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 39/75] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:21 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:22.397601 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9a82992e-50e0-4557-9693-c6110f6c5dd9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:22.399464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9a82992e-50e0-4557-9693-c6110f6c5dd9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:22.415173 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a82992e-50e0-4557-9693-c6110f6c5dd9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:22.417409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a82992e-50e0-4557-9693-c6110f6c5dd9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:22.419431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a82992e-50e0-4557-9693-c6110f6c5dd9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:22.423010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a82992e-50e0-4557-9693-c6110f6c5dd9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:22.425242 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a82992e-50e0-4557-9693-c6110f6c5dd9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:22.426123 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a82992e-50e0-4557-9693-c6110f6c5dd9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:22.820428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-f4ce9cef-dd10-4820-80cb-4f12f3601922 req-5efe46a0-41aa-449c-993a-533cd3eae958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf2e3658-e4d5-4914-8e30-b3e710cdb935", "tag": "ea3bc6ce-56d5-4aa4-8ae0-4ec904dc93e2"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:22.846768 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f4ce9cef-dd10-4820-80cb-4f12f3601922 req-5efe46a0-41aa-449c-993a-533cd3eae958 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:22.857637 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f4ce9cef-dd10-4820-80cb-4f12f3601922 req-5efe46a0-41aa-449c-993a-533cd3eae958 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:22.863529 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f4ce9cef-dd10-4820-80cb-4f12f3601922 req-5efe46a0-41aa-449c-993a-533cd3eae958 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:22.917842 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-f4ce9cef-dd10-4820-80cb-4f12f3601922 req-5efe46a0-41aa-449c-993a-533cd3eae958 service nova] Creating event network-changed:ea3bc6ce-56d5-4aa4-8ae0-4ec904dc93e2 for instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 on hv-cinder-84773 Sep 08 14:00:22.918384 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f4ce9cef-dd10-4820-80cb-4f12f3601922 req-5efe46a0-41aa-449c-993a-533cd3eae958 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=133058) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 14:00:22.918815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f4ce9cef-dd10-4820-80cb-4f12f3601922 req-5efe46a0-41aa-449c-993a-533cd3eae958 service nova] Acquired lock "compute-rpcapi-router" {{(pid=133058) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 14:00:22.934800 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c5-2e85-44a7-a493-9da4bd37ad51 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:22.935742 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c5-2e85-44a7-a493-9da4bd37ad51 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:22.936463 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c5-2e85-44a7-a493-9da4bd37ad51 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:22.937512 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c5-2e85-44a7-a493-9da4bd37ad51 None None] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:22.938383 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c5-2e85-44a7-a493-9da4bd37ad51 None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:22.939380 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c5-2e85-44a7-a493-9da4bd37ad51 None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:22.967853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.compute.rpcapi [None req-0e9ef0c5-2e85-44a7-a493-9da4bd37ad51 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 14:00:22.970122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c5-2e85-44a7-a493-9da4bd37ad51 None None] Releasing lock "compute-rpcapi-router" {{(pid=133058) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 14:00:23.011785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0e9ef0c5-2e85-44a7-a493-9da4bd37ad51 None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.652915 Sep 08 14:00:23.013022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 37/76] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:23.024505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-74ee789d-8ac3-40d5-b3b2-88061da18e57 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:23.026584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-74ee789d-8ac3-40d5-b3b2-88061da18e57 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:23.066634 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74ee789d-8ac3-40d5-b3b2-88061da18e57 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.069958 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74ee789d-8ac3-40d5-b3b2-88061da18e57 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.070710 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74ee789d-8ac3-40d5-b3b2-88061da18e57 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:23.071737 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74ee789d-8ac3-40d5-b3b2-88061da18e57 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.072279 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74ee789d-8ac3-40d5-b3b2-88061da18e57 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.083952 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74ee789d-8ac3-40d5-b3b2-88061da18e57 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:23.124800 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9a82992e-50e0-4557-9693-c6110f6c5dd9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:23.132916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9a82992e-50e0-4557-9693-c6110f6c5dd9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.761217 Sep 08 14:00:23.141035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 40/77] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:22 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:23.435804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-fe751782-dc38-40aa-aab4-6bc97d631dfd req-6adab029-6c39-49b9-be92-e5b663b1781a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6194e5e-54c1-4f8b-a021-be476c67c25e", "tag": "e7a74814-4bc9-432b-b4e2-e2d33d383b16"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:23.453549 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-fe751782-dc38-40aa-aab4-6bc97d631dfd req-6adab029-6c39-49b9-be92-e5b663b1781a service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.454301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-fe751782-dc38-40aa-aab4-6bc97d631dfd req-6adab029-6c39-49b9-be92-e5b663b1781a service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.455122 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-fe751782-dc38-40aa-aab4-6bc97d631dfd req-6adab029-6c39-49b9-be92-e5b663b1781a service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:23.492741 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-fe751782-dc38-40aa-aab4-6bc97d631dfd req-6adab029-6c39-49b9-be92-e5b663b1781a service nova] Creating event network-changed:e7a74814-4bc9-432b-b4e2-e2d33d383b16 for instance e6194e5e-54c1-4f8b-a021-be476c67c25e on hv-cinder-84773 Sep 08 14:00:23.493485 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-fe751782-dc38-40aa-aab4-6bc97d631dfd req-6adab029-6c39-49b9-be92-e5b663b1781a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=133059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 14:00:23.494030 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-fe751782-dc38-40aa-aab4-6bc97d631dfd req-6adab029-6c39-49b9-be92-e5b663b1781a service nova] Acquired lock "compute-rpcapi-router" {{(pid=133059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 14:00:23.495210 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64595586-b855-4e3d-b16e-74a19ed52603 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.496289 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64595586-b855-4e3d-b16e-74a19ed52603 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.496706 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64595586-b855-4e3d-b16e-74a19ed52603 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:23.497481 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64595586-b855-4e3d-b16e-74a19ed52603 None None] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.498073 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64595586-b855-4e3d-b16e-74a19ed52603 None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.498742 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64595586-b855-4e3d-b16e-74a19ed52603 None None] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:23.514624 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.compute.rpcapi [None req-64595586-b855-4e3d-b16e-74a19ed52603 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 14:00:23.522560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64595586-b855-4e3d-b16e-74a19ed52603 None None] Releasing lock "compute-rpcapi-router" {{(pid=133059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 14:00:23.552329 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-64595586-b855-4e3d-b16e-74a19ed52603 None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.417491 Sep 08 14:00:23.555861 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 41/78] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:23.571990 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a1dfc06d-ad67-4d09-bea8-a35a53864fe4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:23.575631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a1dfc06d-ad67-4d09-bea8-a35a53864fe4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:23.594409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1dfc06d-ad67-4d09-bea8-a35a53864fe4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.597815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1dfc06d-ad67-4d09-bea8-a35a53864fe4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.598768 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1dfc06d-ad67-4d09-bea8-a35a53864fe4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:23.602088 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1dfc06d-ad67-4d09-bea8-a35a53864fe4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.605348 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1dfc06d-ad67-4d09-bea8-a35a53864fe4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.605872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1dfc06d-ad67-4d09-bea8-a35a53864fe4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:23.616804 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=28 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:23.789134 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-74ee789d-8ac3-40d5-b3b2-88061da18e57 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:23.794280 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:23.804230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-74ee789d-8ac3-40d5-b3b2-88061da18e57 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.789799 Sep 08 14:00:23.804820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 38/79] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:23 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:23.813071 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9a145c90-7194-461f-9b42-52d4b6877a61 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:23.813912 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9a145c90-7194-461f-9b42-52d4b6877a61 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:23.821609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a145c90-7194-461f-9b42-52d4b6877a61 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.822337 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a145c90-7194-461f-9b42-52d4b6877a61 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.823786 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a145c90-7194-461f-9b42-52d4b6877a61 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:23.824739 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a145c90-7194-461f-9b42-52d4b6877a61 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.826086 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a145c90-7194-461f-9b42-52d4b6877a61 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.826691 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a145c90-7194-461f-9b42-52d4b6877a61 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:24.205736 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a1dfc06d-ad67-4d09-bea8-a35a53864fe4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:24.219058 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a1dfc06d-ad67-4d09-bea8-a35a53864fe4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.660623 Sep 08 14:00:24.220001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 42/80] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:23 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:24.231273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c1368cd8-65b8-4e44-9e84-5e9abeecdde6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:24.233923 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c1368cd8-65b8-4e44-9e84-5e9abeecdde6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:24.241390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c1368cd8-65b8-4e44-9e84-5e9abeecdde6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:24.245085 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c1368cd8-65b8-4e44-9e84-5e9abeecdde6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:24.245085 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c1368cd8-65b8-4e44-9e84-5e9abeecdde6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:24.245085 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c1368cd8-65b8-4e44-9e84-5e9abeecdde6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:24.245085 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c1368cd8-65b8-4e44-9e84-5e9abeecdde6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:24.245943 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c1368cd8-65b8-4e44-9e84-5e9abeecdde6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:24.603484 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9a145c90-7194-461f-9b42-52d4b6877a61 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:24.606621 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9a145c90-7194-461f-9b42-52d4b6877a61 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.798872 Sep 08 14:00:24.620193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 39/81] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:23 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:24.831333 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-16672b08-8630-4d0e-a545-aaf2b253cef0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:24.832032 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-16672b08-8630-4d0e-a545-aaf2b253cef0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:24.841473 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16672b08-8630-4d0e-a545-aaf2b253cef0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:24.845854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16672b08-8630-4d0e-a545-aaf2b253cef0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:24.846166 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16672b08-8630-4d0e-a545-aaf2b253cef0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:24.847199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16672b08-8630-4d0e-a545-aaf2b253cef0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:24.853676 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16672b08-8630-4d0e-a545-aaf2b253cef0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:24.854445 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16672b08-8630-4d0e-a545-aaf2b253cef0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:24.932555 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c1368cd8-65b8-4e44-9e84-5e9abeecdde6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:24.951319 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c1368cd8-65b8-4e44-9e84-5e9abeecdde6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.728922 Sep 08 14:00:24.951950 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 43/82] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:24 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:25.254966 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f565c6ff-a38c-429f-b271-071a1e6ca888 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:25.254966 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f565c6ff-a38c-429f-b271-071a1e6ca888 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:25.255145 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-16672b08-8630-4d0e-a545-aaf2b253cef0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:25.256810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f565c6ff-a38c-429f-b271-071a1e6ca888 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.257603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f565c6ff-a38c-429f-b271-071a1e6ca888 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.258478 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f565c6ff-a38c-429f-b271-071a1e6ca888 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:25.259630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f565c6ff-a38c-429f-b271-071a1e6ca888 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.260822 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f565c6ff-a38c-429f-b271-071a1e6ca888 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.261456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f565c6ff-a38c-429f-b271-071a1e6ca888 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:25.299236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-16672b08-8630-4d0e-a545-aaf2b253cef0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.472323 Sep 08 14:00:25.301194 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 40/83] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:24 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:25.554255 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-ef624d38-1a08-4376-93de-6cb599a8a3b6 req-3cf0070f-9300-4505-922d-1752a734be2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669cbb96-aa6a-43b6-b943-3d6ffef440c7", "tag": "826f910d-daa7-494d-a27b-a16e5794deab"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:25.575390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f565c6ff-a38c-429f-b271-071a1e6ca888 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:25.584947 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f565c6ff-a38c-429f-b271-071a1e6ca888 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.343166 Sep 08 14:00:25.593556 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 44/84] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:25 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:25.621011 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-ef624d38-1a08-4376-93de-6cb599a8a3b6 req-3cf0070f-9300-4505-922d-1752a734be2f service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.622302 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-ef624d38-1a08-4376-93de-6cb599a8a3b6 req-3cf0070f-9300-4505-922d-1752a734be2f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.623040 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-ef624d38-1a08-4376-93de-6cb599a8a3b6 req-3cf0070f-9300-4505-922d-1752a734be2f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:25.639247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0d327f51-b87e-4544-8482-7d3d22d5a67d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:25.639944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0d327f51-b87e-4544-8482-7d3d22d5a67d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:25.653385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0d327f51-b87e-4544-8482-7d3d22d5a67d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.654027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0d327f51-b87e-4544-8482-7d3d22d5a67d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.654467 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0d327f51-b87e-4544-8482-7d3d22d5a67d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:25.655218 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0d327f51-b87e-4544-8482-7d3d22d5a67d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.655686 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0d327f51-b87e-4544-8482-7d3d22d5a67d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.656216 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0d327f51-b87e-4544-8482-7d3d22d5a67d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:25.679384 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-ef624d38-1a08-4376-93de-6cb599a8a3b6 req-3cf0070f-9300-4505-922d-1752a734be2f service nova] Creating event network-changed:826f910d-daa7-494d-a27b-a16e5794deab for instance 669cbb96-aa6a-43b6-b943-3d6ffef440c7 on hv-cinder-84773 Sep 08 14:00:25.708006 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-ef624d38-1a08-4376-93de-6cb599a8a3b6 req-3cf0070f-9300-4505-922d-1752a734be2f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162819 Sep 08 14:00:25.709963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 41/85] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:00:25.904429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-484f2cb9-7e0b-4b3e-9295-1205f79ad4f5 req-ffe27971-4c9c-4fd3-b9eb-6966f3e2cfdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e409e9dd-aae7-4cce-9c1f-2c449abf9093", "tag": "58bdc1ca-5bc3-4026-a9e9-b7ad9f7ea1da"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:25.965213 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-484f2cb9-7e0b-4b3e-9295-1205f79ad4f5 req-ffe27971-4c9c-4fd3-b9eb-6966f3e2cfdf service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.969120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-484f2cb9-7e0b-4b3e-9295-1205f79ad4f5 req-ffe27971-4c9c-4fd3-b9eb-6966f3e2cfdf service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.970207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-484f2cb9-7e0b-4b3e-9295-1205f79ad4f5 req-ffe27971-4c9c-4fd3-b9eb-6966f3e2cfdf service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.039080 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-484f2cb9-7e0b-4b3e-9295-1205f79ad4f5 req-ffe27971-4c9c-4fd3-b9eb-6966f3e2cfdf service nova] Creating event network-changed:58bdc1ca-5bc3-4026-a9e9-b7ad9f7ea1da for instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 on hv-cinder-84773 Sep 08 14:00:26.051074 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-484f2cb9-7e0b-4b3e-9295-1205f79ad4f5 req-ffe27971-4c9c-4fd3-b9eb-6966f3e2cfdf service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168647 Sep 08 14:00:26.052186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 42/86] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:26.065668 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-32e53fc8-4efa-43e7-a95f-e1aafb5d2ea6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:26.066378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-32e53fc8-4efa-43e7-a95f-e1aafb5d2ea6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:26.082874 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32e53fc8-4efa-43e7-a95f-e1aafb5d2ea6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.100200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32e53fc8-4efa-43e7-a95f-e1aafb5d2ea6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.100826 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32e53fc8-4efa-43e7-a95f-e1aafb5d2ea6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.103754 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32e53fc8-4efa-43e7-a95f-e1aafb5d2ea6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.104524 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32e53fc8-4efa-43e7-a95f-e1aafb5d2ea6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.105926 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32e53fc8-4efa-43e7-a95f-e1aafb5d2ea6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.128985 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0d327f51-b87e-4544-8482-7d3d22d5a67d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:26.161334 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0d327f51-b87e-4544-8482-7d3d22d5a67d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.515789 Sep 08 14:00:26.192555 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 45/87] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:25 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:26.327272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-01a334b6-b347-4663-91c0-65140223f2c2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:26.328215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-01a334b6-b347-4663-91c0-65140223f2c2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:26.340507 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a334b6-b347-4663-91c0-65140223f2c2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.342438 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a334b6-b347-4663-91c0-65140223f2c2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.343265 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a334b6-b347-4663-91c0-65140223f2c2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.344312 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a334b6-b347-4663-91c0-65140223f2c2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.345228 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a334b6-b347-4663-91c0-65140223f2c2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.345970 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a334b6-b347-4663-91c0-65140223f2c2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.544920 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-32e53fc8-4efa-43e7-a95f-e1aafb5d2ea6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:26.555131 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-32e53fc8-4efa-43e7-a95f-e1aafb5d2ea6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.501612 Sep 08 14:00:26.559632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 43/88] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:26 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:26.622917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-485695e7-6c65-4434-89ae-800380492c44 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:26.624371 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-485695e7-6c65-4434-89ae-800380492c44 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:26.641168 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-485695e7-6c65-4434-89ae-800380492c44 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.641845 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-485695e7-6c65-4434-89ae-800380492c44 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.642611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-485695e7-6c65-4434-89ae-800380492c44 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.643772 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-485695e7-6c65-4434-89ae-800380492c44 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.644520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-485695e7-6c65-4434-89ae-800380492c44 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.645190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-485695e7-6c65-4434-89ae-800380492c44 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.024718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-485695e7-6c65-4434-89ae-800380492c44 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:27.034037 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-485695e7-6c65-4434-89ae-800380492c44 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.416131 Sep 08 14:00:27.049797 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 44/89] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:26 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:27.170708 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-01a334b6-b347-4663-91c0-65140223f2c2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:27.181537 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-01a334b6-b347-4663-91c0-65140223f2c2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.860080 Sep 08 14:00:27.182984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 46/90] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:26 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:27.214638 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a969cb6f-32da-4e96-bf5c-02d5d1d0ace7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:27.215592 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a969cb6f-32da-4e96-bf5c-02d5d1d0ace7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:27.227851 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a969cb6f-32da-4e96-bf5c-02d5d1d0ace7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:27.229237 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a969cb6f-32da-4e96-bf5c-02d5d1d0ace7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:27.229831 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a969cb6f-32da-4e96-bf5c-02d5d1d0ace7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.230874 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a969cb6f-32da-4e96-bf5c-02d5d1d0ace7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:27.231852 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a969cb6f-32da-4e96-bf5c-02d5d1d0ace7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:27.232340 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a969cb6f-32da-4e96-bf5c-02d5d1d0ace7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.380091 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a969cb6f-32da-4e96-bf5c-02d5d1d0ace7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:27.387950 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a969cb6f-32da-4e96-bf5c-02d5d1d0ace7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.182067 Sep 08 14:00:27.388521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 45/91] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:27 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:27.583453 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-02a258bc-bb84-43f0-bbb7-358e3ab790d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:27.584193 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-02a258bc-bb84-43f0-bbb7-358e3ab790d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:27.591722 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02a258bc-bb84-43f0-bbb7-358e3ab790d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:27.592227 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02a258bc-bb84-43f0-bbb7-358e3ab790d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:27.593065 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02a258bc-bb84-43f0-bbb7-358e3ab790d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.593394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02a258bc-bb84-43f0-bbb7-358e3ab790d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:27.593855 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02a258bc-bb84-43f0-bbb7-358e3ab790d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:27.594335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02a258bc-bb84-43f0-bbb7-358e3ab790d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.739976 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-02a258bc-bb84-43f0-bbb7-358e3ab790d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:27.749261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-02a258bc-bb84-43f0-bbb7-358e3ab790d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.169855 Sep 08 14:00:27.749844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 47/92] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:27 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:28.062295 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-39c1d190-0f0c-4b7e-a868-ec077d0b63eb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:28.068150 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-aa24f9e8-3492-412b-8bbd-35bb029f51be req-032377bf-f3f9-4c67-a146-dab2a731b1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd10060-2469-49e3-a8c3-949a359181f8", "tag": "5a142423-c154-4b43-a8f8-2a5d3c52910e"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:28.075613 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-39c1d190-0f0c-4b7e-a868-ec077d0b63eb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:28.082165 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39c1d190-0f0c-4b7e-a868-ec077d0b63eb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.082657 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39c1d190-0f0c-4b7e-a868-ec077d0b63eb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.083131 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39c1d190-0f0c-4b7e-a868-ec077d0b63eb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.083834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39c1d190-0f0c-4b7e-a868-ec077d0b63eb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.084286 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39c1d190-0f0c-4b7e-a868-ec077d0b63eb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.084709 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39c1d190-0f0c-4b7e-a868-ec077d0b63eb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.092403 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-aa24f9e8-3492-412b-8bbd-35bb029f51be req-032377bf-f3f9-4c67-a146-dab2a731b1b8 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.092972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-aa24f9e8-3492-412b-8bbd-35bb029f51be req-032377bf-f3f9-4c67-a146-dab2a731b1b8 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.093404 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-aa24f9e8-3492-412b-8bbd-35bb029f51be req-032377bf-f3f9-4c67-a146-dab2a731b1b8 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.119838 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-aa24f9e8-3492-412b-8bbd-35bb029f51be req-032377bf-f3f9-4c67-a146-dab2a731b1b8 service nova] Creating event network-changed:5a142423-c154-4b43-a8f8-2a5d3c52910e for instance edd10060-2469-49e3-a8c3-949a359181f8 on hv-cinder-84773 Sep 08 14:00:28.123405 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-aa24f9e8-3492-412b-8bbd-35bb029f51be req-032377bf-f3f9-4c67-a146-dab2a731b1b8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059118 Sep 08 14:00:28.124011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 48/93] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:28.206269 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9b82de6f-2b5e-45aa-b222-89ba0ba4a485 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:28.207216 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9b82de6f-2b5e-45aa-b222-89ba0ba4a485 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:28.214985 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9b82de6f-2b5e-45aa-b222-89ba0ba4a485 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.218249 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9b82de6f-2b5e-45aa-b222-89ba0ba4a485 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.218249 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9b82de6f-2b5e-45aa-b222-89ba0ba4a485 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.218249 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9b82de6f-2b5e-45aa-b222-89ba0ba4a485 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.218249 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9b82de6f-2b5e-45aa-b222-89ba0ba4a485 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.218573 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9b82de6f-2b5e-45aa-b222-89ba0ba4a485 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.333309 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-39c1d190-0f0c-4b7e-a868-ec077d0b63eb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:28.341344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-39c1d190-0f0c-4b7e-a868-ec077d0b63eb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.282982 Sep 08 14:00:28.342126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 46/94] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:28 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:28.370700 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9b82de6f-2b5e-45aa-b222-89ba0ba4a485 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:28.380006 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9b82de6f-2b5e-45aa-b222-89ba0ba4a485 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.177728 Sep 08 14:00:28.387584 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 49/95] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:28 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:28.416093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8bf010c0-a383-4e58-8963-648224a35e29 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:28.417875 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8bf010c0-a383-4e58-8963-648224a35e29 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:28.424784 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bf010c0-a383-4e58-8963-648224a35e29 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.425425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bf010c0-a383-4e58-8963-648224a35e29 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.425946 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bf010c0-a383-4e58-8963-648224a35e29 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.426923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bf010c0-a383-4e58-8963-648224a35e29 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.427888 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bf010c0-a383-4e58-8963-648224a35e29 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.428572 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bf010c0-a383-4e58-8963-648224a35e29 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.566075 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8bf010c0-a383-4e58-8963-648224a35e29 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:28.574342 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8bf010c0-a383-4e58-8963-648224a35e29 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.161945 Sep 08 14:00:28.575068 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 47/96] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:28 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:28.773294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d08426e4-c346-4bb7-8b6f-0fade6e2216e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:28.773844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d08426e4-c346-4bb7-8b6f-0fade6e2216e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:28.780859 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d08426e4-c346-4bb7-8b6f-0fade6e2216e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.781504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d08426e4-c346-4bb7-8b6f-0fade6e2216e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.781937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d08426e4-c346-4bb7-8b6f-0fade6e2216e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.782648 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d08426e4-c346-4bb7-8b6f-0fade6e2216e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.783167 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d08426e4-c346-4bb7-8b6f-0fade6e2216e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.783553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d08426e4-c346-4bb7-8b6f-0fade6e2216e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.923321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d08426e4-c346-4bb7-8b6f-0fade6e2216e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:28.931078 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d08426e4-c346-4bb7-8b6f-0fade6e2216e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.161741 Sep 08 14:00:28.931643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 50/97] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:28 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:29.366793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-010bbc98-b1b8-475d-99a8-8930dd2f22f2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:29.368105 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-010bbc98-b1b8-475d-99a8-8930dd2f22f2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:29.376671 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-010bbc98-b1b8-475d-99a8-8930dd2f22f2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.379938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-010bbc98-b1b8-475d-99a8-8930dd2f22f2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.379938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-010bbc98-b1b8-475d-99a8-8930dd2f22f2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.379938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-010bbc98-b1b8-475d-99a8-8930dd2f22f2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.379938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-010bbc98-b1b8-475d-99a8-8930dd2f22f2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.380295 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-010bbc98-b1b8-475d-99a8-8930dd2f22f2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.403666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7a393076-073e-4de0-84c9-bd631c7f2e6d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:29.404273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7a393076-073e-4de0-84c9-bd631c7f2e6d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:29.410993 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a393076-073e-4de0-84c9-bd631c7f2e6d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.411473 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a393076-073e-4de0-84c9-bd631c7f2e6d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.411896 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a393076-073e-4de0-84c9-bd631c7f2e6d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.414015 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a393076-073e-4de0-84c9-bd631c7f2e6d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.414015 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a393076-073e-4de0-84c9-bd631c7f2e6d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.414015 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a393076-073e-4de0-84c9-bd631c7f2e6d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.525668 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-010bbc98-b1b8-475d-99a8-8930dd2f22f2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:29.544824 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-010bbc98-b1b8-475d-99a8-8930dd2f22f2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.173305 Sep 08 14:00:29.544824 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 48/98] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:29 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:29.570112 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7a393076-073e-4de0-84c9-bd631c7f2e6d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:29.578668 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7a393076-073e-4de0-84c9-bd631c7f2e6d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.179814 Sep 08 14:00:29.579325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 51/99] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:29 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:29.604564 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-07520e3b-cfff-4645-8453-89f5d057ba7d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:29.605452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-07520e3b-cfff-4645-8453-89f5d057ba7d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:29.620467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-07520e3b-cfff-4645-8453-89f5d057ba7d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.620467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-07520e3b-cfff-4645-8453-89f5d057ba7d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.620467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-07520e3b-cfff-4645-8453-89f5d057ba7d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.620467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-07520e3b-cfff-4645-8453-89f5d057ba7d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.621202 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-07520e3b-cfff-4645-8453-89f5d057ba7d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.621202 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-07520e3b-cfff-4645-8453-89f5d057ba7d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.802588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-07520e3b-cfff-4645-8453-89f5d057ba7d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:29.815554 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-07520e3b-cfff-4645-8453-89f5d057ba7d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.214836 Sep 08 14:00:29.816948 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 49/100] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:29 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:29.953190 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7be6c353-0d33-410d-8d6d-a7bec053882b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:29.953798 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7be6c353-0d33-410d-8d6d-a7bec053882b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:29.959942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7be6c353-0d33-410d-8d6d-a7bec053882b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.960421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7be6c353-0d33-410d-8d6d-a7bec053882b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.960854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7be6c353-0d33-410d-8d6d-a7bec053882b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.961545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7be6c353-0d33-410d-8d6d-a7bec053882b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.962031 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7be6c353-0d33-410d-8d6d-a7bec053882b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.962454 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7be6c353-0d33-410d-8d6d-a7bec053882b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:30.110206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7be6c353-0d33-410d-8d6d-a7bec053882b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:30.118696 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7be6c353-0d33-410d-8d6d-a7bec053882b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.169288 Sep 08 14:00:30.119325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 52/101] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:29 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:30.559203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f190aa18-61c4-4034-9805-2f7ad4f5d74e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:30.559711 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f190aa18-61c4-4034-9805-2f7ad4f5d74e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:30.565853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f190aa18-61c4-4034-9805-2f7ad4f5d74e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:30.566330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f190aa18-61c4-4034-9805-2f7ad4f5d74e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:30.574310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f190aa18-61c4-4034-9805-2f7ad4f5d74e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:30.574310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f190aa18-61c4-4034-9805-2f7ad4f5d74e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:30.574310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f190aa18-61c4-4034-9805-2f7ad4f5d74e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:30.574310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f190aa18-61c4-4034-9805-2f7ad4f5d74e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:30.601677 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-68d19136-4e8a-4982-96f4-432d7bf60d3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:30.602323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-68d19136-4e8a-4982-96f4-432d7bf60d3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:30.610703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68d19136-4e8a-4982-96f4-432d7bf60d3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:30.613608 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68d19136-4e8a-4982-96f4-432d7bf60d3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:30.614028 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68d19136-4e8a-4982-96f4-432d7bf60d3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:30.614772 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68d19136-4e8a-4982-96f4-432d7bf60d3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:30.615266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68d19136-4e8a-4982-96f4-432d7bf60d3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:30.615719 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68d19136-4e8a-4982-96f4-432d7bf60d3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:30.708371 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f190aa18-61c4-4034-9805-2f7ad4f5d74e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:30.718549 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f190aa18-61c4-4034-9805-2f7ad4f5d74e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.163278 Sep 08 14:00:30.719238 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 50/102] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:30 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:30.785991 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-68d19136-4e8a-4982-96f4-432d7bf60d3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:30.793533 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-68d19136-4e8a-4982-96f4-432d7bf60d3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.195784 Sep 08 14:00:30.794137 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 53/103] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:30 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:30.850692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3ce23386-2909-4c75-9a99-4cfa72f256b7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:30.851542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3ce23386-2909-4c75-9a99-4cfa72f256b7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:30.858490 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ce23386-2909-4c75-9a99-4cfa72f256b7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:30.859183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ce23386-2909-4c75-9a99-4cfa72f256b7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:30.860367 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ce23386-2909-4c75-9a99-4cfa72f256b7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:30.860756 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ce23386-2909-4c75-9a99-4cfa72f256b7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:30.861350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ce23386-2909-4c75-9a99-4cfa72f256b7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:30.861913 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ce23386-2909-4c75-9a99-4cfa72f256b7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:31.006971 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3ce23386-2909-4c75-9a99-4cfa72f256b7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:31.016226 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3ce23386-2909-4c75-9a99-4cfa72f256b7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.169182 Sep 08 14:00:31.017087 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 51/104] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:30 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:31.142872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-840b30b7-43a3-4d76-a36b-3108e376f706 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:31.143504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-840b30b7-43a3-4d76-a36b-3108e376f706 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:31.150058 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-840b30b7-43a3-4d76-a36b-3108e376f706 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:31.150581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-840b30b7-43a3-4d76-a36b-3108e376f706 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:31.151060 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-840b30b7-43a3-4d76-a36b-3108e376f706 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:31.153011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-840b30b7-43a3-4d76-a36b-3108e376f706 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:31.153011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-840b30b7-43a3-4d76-a36b-3108e376f706 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:31.153618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-840b30b7-43a3-4d76-a36b-3108e376f706 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:31.311282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-840b30b7-43a3-4d76-a36b-3108e376f706 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:31.315045 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-840b30b7-43a3-4d76-a36b-3108e376f706 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.176180 Sep 08 14:00:31.315687 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 54/105] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:31 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:31.741700 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4b42259e-eebc-49d6-8b43-f3bb0593a43e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:31.742316 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4b42259e-eebc-49d6-8b43-f3bb0593a43e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:31.748339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4b42259e-eebc-49d6-8b43-f3bb0593a43e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:31.748829 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4b42259e-eebc-49d6-8b43-f3bb0593a43e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:31.749254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4b42259e-eebc-49d6-8b43-f3bb0593a43e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:31.749948 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4b42259e-eebc-49d6-8b43-f3bb0593a43e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:31.750394 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4b42259e-eebc-49d6-8b43-f3bb0593a43e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:31.750812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4b42259e-eebc-49d6-8b43-f3bb0593a43e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:31.817812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5715f27d-2023-4a4d-a68d-c20ec2bf7f5a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:31.818544 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5715f27d-2023-4a4d-a68d-c20ec2bf7f5a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:31.826093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5715f27d-2023-4a4d-a68d-c20ec2bf7f5a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:31.826591 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5715f27d-2023-4a4d-a68d-c20ec2bf7f5a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:31.827064 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5715f27d-2023-4a4d-a68d-c20ec2bf7f5a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:31.827764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5715f27d-2023-4a4d-a68d-c20ec2bf7f5a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:31.828217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5715f27d-2023-4a4d-a68d-c20ec2bf7f5a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:31.828652 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5715f27d-2023-4a4d-a68d-c20ec2bf7f5a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:31.850764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=100 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:31.916420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4b42259e-eebc-49d6-8b43-f3bb0593a43e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:31.924956 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4b42259e-eebc-49d6-8b43-f3bb0593a43e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.187173 Sep 08 14:00:31.939100 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 52/106] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:31 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:31.986039 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5715f27d-2023-4a4d-a68d-c20ec2bf7f5a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:31.993950 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5715f27d-2023-4a4d-a68d-c20ec2bf7f5a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.180686 Sep 08 14:00:31.994530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 55/107] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:31 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:32.042401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7dc31d42-8333-4e74-b5da-cd4a7f638b47 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:32.043322 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7dc31d42-8333-4e74-b5da-cd4a7f638b47 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:32.050579 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dc31d42-8333-4e74-b5da-cd4a7f638b47 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:32.051088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dc31d42-8333-4e74-b5da-cd4a7f638b47 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:32.051521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dc31d42-8333-4e74-b5da-cd4a7f638b47 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:32.052398 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dc31d42-8333-4e74-b5da-cd4a7f638b47 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:32.052851 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dc31d42-8333-4e74-b5da-cd4a7f638b47 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:32.053471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dc31d42-8333-4e74-b5da-cd4a7f638b47 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:32.254397 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7dc31d42-8333-4e74-b5da-cd4a7f638b47 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:32.270456 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7dc31d42-8333-4e74-b5da-cd4a7f638b47 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.232832 Sep 08 14:00:32.273390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 53/108] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:32 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:32.340534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3dde6cba-62f8-40cb-a420-b59543aeb545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:32.341858 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3dde6cba-62f8-40cb-a420-b59543aeb545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:32.347880 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3dde6cba-62f8-40cb-a420-b59543aeb545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:32.348481 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3dde6cba-62f8-40cb-a420-b59543aeb545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:32.349129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3dde6cba-62f8-40cb-a420-b59543aeb545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:32.349876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3dde6cba-62f8-40cb-a420-b59543aeb545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:32.350350 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3dde6cba-62f8-40cb-a420-b59543aeb545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:32.350815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3dde6cba-62f8-40cb-a420-b59543aeb545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:32.497256 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3dde6cba-62f8-40cb-a420-b59543aeb545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:32.504981 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3dde6cba-62f8-40cb-a420-b59543aeb545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.170062 Sep 08 14:00:32.505565 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 56/109] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:32 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:32.949521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-124fe0bd-3e9a-4705-b2e4-0fcba4f7f589 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:32.950521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-124fe0bd-3e9a-4705-b2e4-0fcba4f7f589 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:32.956938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:32.958669 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-124fe0bd-3e9a-4705-b2e4-0fcba4f7f589 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:32.959282 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-124fe0bd-3e9a-4705-b2e4-0fcba4f7f589 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:32.959860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-124fe0bd-3e9a-4705-b2e4-0fcba4f7f589 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:32.966137 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-124fe0bd-3e9a-4705-b2e4-0fcba4f7f589 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:32.966137 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-124fe0bd-3e9a-4705-b2e4-0fcba4f7f589 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:32.966137 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-124fe0bd-3e9a-4705-b2e4-0fcba4f7f589 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.017122 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6aab85c7-f411-4333-87df-22618e4eca65 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:33.017844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6aab85c7-f411-4333-87df-22618e4eca65 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:33.024344 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6aab85c7-f411-4333-87df-22618e4eca65 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.024647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6aab85c7-f411-4333-87df-22618e4eca65 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.025339 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6aab85c7-f411-4333-87df-22618e4eca65 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.026046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6aab85c7-f411-4333-87df-22618e4eca65 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.026526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6aab85c7-f411-4333-87df-22618e4eca65 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.027007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6aab85c7-f411-4333-87df-22618e4eca65 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.111886 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-124fe0bd-3e9a-4705-b2e4-0fcba4f7f589 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:33.120543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-124fe0bd-3e9a-4705-b2e4-0fcba4f7f589 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.175835 Sep 08 14:00:33.121210 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 54/110] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:32 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:33.223309 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-6aab85c7-f411-4333-87df-22618e4eca65 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:33.232379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6aab85c7-f411-4333-87df-22618e4eca65 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.219405 Sep 08 14:00:33.232955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 57/111] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:33 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:33.300021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1d8ebca6-2e69-40f7-b0a0-c375d819a31a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:33.300633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1d8ebca6-2e69-40f7-b0a0-c375d819a31a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:33.306699 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d8ebca6-2e69-40f7-b0a0-c375d819a31a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.307242 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d8ebca6-2e69-40f7-b0a0-c375d819a31a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.307700 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d8ebca6-2e69-40f7-b0a0-c375d819a31a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.308388 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d8ebca6-2e69-40f7-b0a0-c375d819a31a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.308839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d8ebca6-2e69-40f7-b0a0-c375d819a31a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.309254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d8ebca6-2e69-40f7-b0a0-c375d819a31a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.457322 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1d8ebca6-2e69-40f7-b0a0-c375d819a31a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:33.466782 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1d8ebca6-2e69-40f7-b0a0-c375d819a31a tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.170738 Sep 08 14:00:33.467402 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 55/112] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:33 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:33.530610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-73588ad1-1268-4aad-b429-750f712e4bfd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:33.531371 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-73588ad1-1268-4aad-b429-750f712e4bfd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:33.534408 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:33.538417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-73588ad1-1268-4aad-b429-750f712e4bfd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.539370 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-73588ad1-1268-4aad-b429-750f712e4bfd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.539844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-73588ad1-1268-4aad-b429-750f712e4bfd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.541934 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-73588ad1-1268-4aad-b429-750f712e4bfd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.542361 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-73588ad1-1268-4aad-b429-750f712e4bfd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.542538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-73588ad1-1268-4aad-b429-750f712e4bfd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.723674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-73588ad1-1268-4aad-b429-750f712e4bfd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:33.732402 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-73588ad1-1268-4aad-b429-750f712e4bfd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.206556 Sep 08 14:00:33.734021 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 58/113] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:33 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:34.146001 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4dd83101-91b5-4a90-8d07-2a4ef1e77928 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:34.147310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4dd83101-91b5-4a90-8d07-2a4ef1e77928 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:34.155307 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4dd83101-91b5-4a90-8d07-2a4ef1e77928 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.156213 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4dd83101-91b5-4a90-8d07-2a4ef1e77928 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.157050 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4dd83101-91b5-4a90-8d07-2a4ef1e77928 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.157858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4dd83101-91b5-4a90-8d07-2a4ef1e77928 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.158391 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4dd83101-91b5-4a90-8d07-2a4ef1e77928 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.158857 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4dd83101-91b5-4a90-8d07-2a4ef1e77928 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.258640 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0da32120-4ece-4eba-8d80-273cca6c2b35 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:34.261863 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0da32120-4ece-4eba-8d80-273cca6c2b35 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:34.270177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0da32120-4ece-4eba-8d80-273cca6c2b35 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.271255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0da32120-4ece-4eba-8d80-273cca6c2b35 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.272153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0da32120-4ece-4eba-8d80-273cca6c2b35 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.273364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0da32120-4ece-4eba-8d80-273cca6c2b35 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.273856 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0da32120-4ece-4eba-8d80-273cca6c2b35 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.274565 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0da32120-4ece-4eba-8d80-273cca6c2b35 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.312877 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4dd83101-91b5-4a90-8d07-2a4ef1e77928 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:34.316431 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:34.321080 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4dd83101-91b5-4a90-8d07-2a4ef1e77928 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.179707 Sep 08 14:00:34.321668 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 56/114] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:34 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:34.428660 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0da32120-4ece-4eba-8d80-273cca6c2b35 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:34.441446 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0da32120-4ece-4eba-8d80-273cca6c2b35 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.188755 Sep 08 14:00:34.442403 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 59/115] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:34 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:34.492335 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4ff0bb59-537c-4d03-bf62-1dab4307fd41 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:34.493033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4ff0bb59-537c-4d03-bf62-1dab4307fd41 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:34.499396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ff0bb59-537c-4d03-bf62-1dab4307fd41 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.499914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ff0bb59-537c-4d03-bf62-1dab4307fd41 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.500350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ff0bb59-537c-4d03-bf62-1dab4307fd41 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.501074 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ff0bb59-537c-4d03-bf62-1dab4307fd41 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.501529 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ff0bb59-537c-4d03-bf62-1dab4307fd41 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.501953 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ff0bb59-537c-4d03-bf62-1dab4307fd41 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.657336 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4ff0bb59-537c-4d03-bf62-1dab4307fd41 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:34.665522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4ff0bb59-537c-4d03-bf62-1dab4307fd41 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.177293 Sep 08 14:00:34.666106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 57/116] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:34 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:34.773888 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-277c364e-95d0-411f-a36c-dd6e17800844 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:34.775062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-277c364e-95d0-411f-a36c-dd6e17800844 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:34.781301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-277c364e-95d0-411f-a36c-dd6e17800844 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.781793 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-277c364e-95d0-411f-a36c-dd6e17800844 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.782233 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-277c364e-95d0-411f-a36c-dd6e17800844 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.782930 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-277c364e-95d0-411f-a36c-dd6e17800844 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.783941 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-277c364e-95d0-411f-a36c-dd6e17800844 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.784475 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-277c364e-95d0-411f-a36c-dd6e17800844 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.929028 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-277c364e-95d0-411f-a36c-dd6e17800844 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:34.937639 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-277c364e-95d0-411f-a36c-dd6e17800844 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.167537 Sep 08 14:00:34.938228 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 60/117] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:34 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:35.350008 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-90bcc196-c1c9-4bdc-aa79-3722945f0758 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:35.351031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-90bcc196-c1c9-4bdc-aa79-3722945f0758 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:35.359273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90bcc196-c1c9-4bdc-aa79-3722945f0758 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.360320 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90bcc196-c1c9-4bdc-aa79-3722945f0758 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.360832 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90bcc196-c1c9-4bdc-aa79-3722945f0758 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.361770 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90bcc196-c1c9-4bdc-aa79-3722945f0758 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.366034 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90bcc196-c1c9-4bdc-aa79-3722945f0758 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.366445 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90bcc196-c1c9-4bdc-aa79-3722945f0758 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.478905 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a1017439-9985-4ac8-a408-ae2b27813a97 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:35.480469 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a1017439-9985-4ac8-a408-ae2b27813a97 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:35.495779 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1017439-9985-4ac8-a408-ae2b27813a97 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.496557 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1017439-9985-4ac8-a408-ae2b27813a97 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.497183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1017439-9985-4ac8-a408-ae2b27813a97 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.499334 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1017439-9985-4ac8-a408-ae2b27813a97 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.499820 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1017439-9985-4ac8-a408-ae2b27813a97 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.500315 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1017439-9985-4ac8-a408-ae2b27813a97 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.606706 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-90bcc196-c1c9-4bdc-aa79-3722945f0758 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:35.618083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-90bcc196-c1c9-4bdc-aa79-3722945f0758 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.274060 Sep 08 14:00:35.619403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 58/118] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:35 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:35.692551 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7db789d8-6d24-4dbd-abd0-060e1b40b6f1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:35.693236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7db789d8-6d24-4dbd-abd0-060e1b40b6f1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:35.701722 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7db789d8-6d24-4dbd-abd0-060e1b40b6f1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.702527 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7db789d8-6d24-4dbd-abd0-060e1b40b6f1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.703304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7db789d8-6d24-4dbd-abd0-060e1b40b6f1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.709624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7db789d8-6d24-4dbd-abd0-060e1b40b6f1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.709624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7db789d8-6d24-4dbd-abd0-060e1b40b6f1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.709624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7db789d8-6d24-4dbd-abd0-060e1b40b6f1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.789511 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a1017439-9985-4ac8-a408-ae2b27813a97 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:35.800808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a1017439-9985-4ac8-a408-ae2b27813a97 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.325773 Sep 08 14:00:35.801662 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 61/119] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:35 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:35.965621 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3c7a15ab-b02a-4cb7-a8f2-e35ed8876f97 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:35.966880 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3c7a15ab-b02a-4cb7-a8f2-e35ed8876f97 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:35.979080 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7a15ab-b02a-4cb7-a8f2-e35ed8876f97 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.980482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7a15ab-b02a-4cb7-a8f2-e35ed8876f97 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.981214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7a15ab-b02a-4cb7-a8f2-e35ed8876f97 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.982192 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7a15ab-b02a-4cb7-a8f2-e35ed8876f97 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.983009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7a15ab-b02a-4cb7-a8f2-e35ed8876f97 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.983642 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7a15ab-b02a-4cb7-a8f2-e35ed8876f97 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.157831 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7db789d8-6d24-4dbd-abd0-060e1b40b6f1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:36.166166 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7db789d8-6d24-4dbd-abd0-060e1b40b6f1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.478957 Sep 08 14:00:36.166784 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 59/120] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:35 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:36.426287 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3c7a15ab-b02a-4cb7-a8f2-e35ed8876f97 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:36.437411 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3c7a15ab-b02a-4cb7-a8f2-e35ed8876f97 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.479101 Sep 08 14:00:36.454804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 62/121] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:35 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:36.645808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d046681c-7117-47e8-a4c6-4523b88aec59 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:36.647126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d046681c-7117-47e8-a4c6-4523b88aec59 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:36.654469 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d046681c-7117-47e8-a4c6-4523b88aec59 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.654974 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d046681c-7117-47e8-a4c6-4523b88aec59 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.655406 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d046681c-7117-47e8-a4c6-4523b88aec59 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.656151 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d046681c-7117-47e8-a4c6-4523b88aec59 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.656598 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d046681c-7117-47e8-a4c6-4523b88aec59 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.657010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d046681c-7117-47e8-a4c6-4523b88aec59 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.843357 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-dc06c5f4-ebe4-4e5f-a75c-bb1a01ac2cc2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:36.843971 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-dc06c5f4-ebe4-4e5f-a75c-bb1a01ac2cc2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:36.857264 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dc06c5f4-ebe4-4e5f-a75c-bb1a01ac2cc2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.857882 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dc06c5f4-ebe4-4e5f-a75c-bb1a01ac2cc2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.858346 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dc06c5f4-ebe4-4e5f-a75c-bb1a01ac2cc2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.859088 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dc06c5f4-ebe4-4e5f-a75c-bb1a01ac2cc2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.859540 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dc06c5f4-ebe4-4e5f-a75c-bb1a01ac2cc2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.859962 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dc06c5f4-ebe4-4e5f-a75c-bb1a01ac2cc2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.976682 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d046681c-7117-47e8-a4c6-4523b88aec59 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:36.986394 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d046681c-7117-47e8-a4c6-4523b88aec59 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.344613 Sep 08 14:00:37.002925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 60/122] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:36 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:37.070317 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-dc06c5f4-ebe4-4e5f-a75c-bb1a01ac2cc2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:37.078494 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-dc06c5f4-ebe4-4e5f-a75c-bb1a01ac2cc2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.239419 Sep 08 14:00:37.079081 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 63/123] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:36 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:37.188752 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-dc8f788d-a721-4a8d-8a12-efffabbe52c7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:37.189638 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-dc8f788d-a721-4a8d-8a12-efffabbe52c7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:37.196984 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dc8f788d-a721-4a8d-8a12-efffabbe52c7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:37.197627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dc8f788d-a721-4a8d-8a12-efffabbe52c7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:37.198801 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dc8f788d-a721-4a8d-8a12-efffabbe52c7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:37.199901 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dc8f788d-a721-4a8d-8a12-efffabbe52c7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:37.200553 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dc8f788d-a721-4a8d-8a12-efffabbe52c7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:37.201007 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dc8f788d-a721-4a8d-8a12-efffabbe52c7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:37.425126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-dc8f788d-a721-4a8d-8a12-efffabbe52c7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:37.452195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-dc8f788d-a721-4a8d-8a12-efffabbe52c7 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.267358 Sep 08 14:00:37.469005 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 61/124] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:37 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:37.474042 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-96601b46-2256-4d6a-8040-9890ff9a2696 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:37.474690 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-96601b46-2256-4d6a-8040-9890ff9a2696 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:37.491887 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96601b46-2256-4d6a-8040-9890ff9a2696 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:37.492368 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96601b46-2256-4d6a-8040-9890ff9a2696 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:37.492811 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96601b46-2256-4d6a-8040-9890ff9a2696 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:37.493791 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96601b46-2256-4d6a-8040-9890ff9a2696 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:37.494418 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96601b46-2256-4d6a-8040-9890ff9a2696 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:37.494938 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96601b46-2256-4d6a-8040-9890ff9a2696 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:37.929459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-96601b46-2256-4d6a-8040-9890ff9a2696 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:37.940216 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-96601b46-2256-4d6a-8040-9890ff9a2696 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.477546 Sep 08 14:00:37.940803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 64/125] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:37 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:38.015931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ec1bae65-8604-4f61-ab5b-be4fed620f5e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:38.016763 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ec1bae65-8604-4f61-ab5b-be4fed620f5e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:38.026724 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec1bae65-8604-4f61-ab5b-be4fed620f5e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.027939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec1bae65-8604-4f61-ab5b-be4fed620f5e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.029661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec1bae65-8604-4f61-ab5b-be4fed620f5e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.031179 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec1bae65-8604-4f61-ab5b-be4fed620f5e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.032861 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec1bae65-8604-4f61-ab5b-be4fed620f5e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.035676 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec1bae65-8604-4f61-ab5b-be4fed620f5e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.102404 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-783b2f86-68a8-4f9f-b94d-040e7d731efb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:38.103140 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-783b2f86-68a8-4f9f-b94d-040e7d731efb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:38.126022 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-783b2f86-68a8-4f9f-b94d-040e7d731efb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.126580 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-783b2f86-68a8-4f9f-b94d-040e7d731efb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.127276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-783b2f86-68a8-4f9f-b94d-040e7d731efb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.129726 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-783b2f86-68a8-4f9f-b94d-040e7d731efb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.131533 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-783b2f86-68a8-4f9f-b94d-040e7d731efb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.131958 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-783b2f86-68a8-4f9f-b94d-040e7d731efb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.306318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ec1bae65-8604-4f61-ab5b-be4fed620f5e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:38.319705 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ec1bae65-8604-4f61-ab5b-be4fed620f5e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.310252 Sep 08 14:00:38.320872 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 62/126] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:38 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:38.354255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-783b2f86-68a8-4f9f-b94d-040e7d731efb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:38.367195 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-783b2f86-68a8-4f9f-b94d-040e7d731efb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.263940 Sep 08 14:00:38.367195 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 65/127] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:38 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:38.478525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0919f610-3925-448f-8855-36f0348326e5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:38.478525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0919f610-3925-448f-8855-36f0348326e5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:38.508836 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0919f610-3925-448f-8855-36f0348326e5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.512254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0919f610-3925-448f-8855-36f0348326e5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.512718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0919f610-3925-448f-8855-36f0348326e5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.513456 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0919f610-3925-448f-8855-36f0348326e5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.513903 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0919f610-3925-448f-8855-36f0348326e5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.514322 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0919f610-3925-448f-8855-36f0348326e5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.693304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0919f610-3925-448f-8855-36f0348326e5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:38.704627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0919f610-3925-448f-8855-36f0348326e5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.230670 Sep 08 14:00:38.705632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 63/128] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:38 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:38.964688 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-02c5f870-d50f-4162-8939-6bc73a468a6a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:38.965373 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-02c5f870-d50f-4162-8939-6bc73a468a6a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:38.975443 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02c5f870-d50f-4162-8939-6bc73a468a6a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.984412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02c5f870-d50f-4162-8939-6bc73a468a6a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.984412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02c5f870-d50f-4162-8939-6bc73a468a6a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.984412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02c5f870-d50f-4162-8939-6bc73a468a6a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.984412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02c5f870-d50f-4162-8939-6bc73a468a6a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.985114 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02c5f870-d50f-4162-8939-6bc73a468a6a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.134057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-02c5f870-d50f-4162-8939-6bc73a468a6a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:39.142431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-02c5f870-d50f-4162-8939-6bc73a468a6a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.183089 Sep 08 14:00:39.143199 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 66/129] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:38 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:39.347563 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2ad182f6-b5a9-449a-9cb7-19744039ac65 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:39.348540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2ad182f6-b5a9-449a-9cb7-19744039ac65 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:39.355579 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ad182f6-b5a9-449a-9cb7-19744039ac65 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.356118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ad182f6-b5a9-449a-9cb7-19744039ac65 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.356721 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ad182f6-b5a9-449a-9cb7-19744039ac65 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.357651 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ad182f6-b5a9-449a-9cb7-19744039ac65 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.358107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ad182f6-b5a9-449a-9cb7-19744039ac65 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.358526 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ad182f6-b5a9-449a-9cb7-19744039ac65 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.397118 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e5b578eb-372e-480e-85ad-1f4b2aac2d2a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:39.397942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e5b578eb-372e-480e-85ad-1f4b2aac2d2a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:39.410819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5b578eb-372e-480e-85ad-1f4b2aac2d2a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.411486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5b578eb-372e-480e-85ad-1f4b2aac2d2a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.412023 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5b578eb-372e-480e-85ad-1f4b2aac2d2a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.414832 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5b578eb-372e-480e-85ad-1f4b2aac2d2a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.415487 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5b578eb-372e-480e-85ad-1f4b2aac2d2a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.416018 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5b578eb-372e-480e-85ad-1f4b2aac2d2a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.526370 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2ad182f6-b5a9-449a-9cb7-19744039ac65 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:39.534495 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2ad182f6-b5a9-449a-9cb7-19744039ac65 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.190727 Sep 08 14:00:39.535110 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 64/130] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:39 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:39.567945 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e5b578eb-372e-480e-85ad-1f4b2aac2d2a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:39.575709 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e5b578eb-372e-480e-85ad-1f4b2aac2d2a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.183316 Sep 08 14:00:39.576276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 67/131] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:39 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:39.733656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1a9bfdaa-cfad-4e38-8bea-66b258d8e540 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:39.734183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1a9bfdaa-cfad-4e38-8bea-66b258d8e540 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:39.740379 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1a9bfdaa-cfad-4e38-8bea-66b258d8e540 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.740862 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1a9bfdaa-cfad-4e38-8bea-66b258d8e540 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.741283 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1a9bfdaa-cfad-4e38-8bea-66b258d8e540 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.741976 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1a9bfdaa-cfad-4e38-8bea-66b258d8e540 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.742445 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1a9bfdaa-cfad-4e38-8bea-66b258d8e540 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.742855 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1a9bfdaa-cfad-4e38-8bea-66b258d8e540 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.901578 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1a9bfdaa-cfad-4e38-8bea-66b258d8e540 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:39.910172 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1a9bfdaa-cfad-4e38-8bea-66b258d8e540 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.180803 Sep 08 14:00:39.910695 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 65/132] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:39 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:40.165604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0e072cb2-547e-481e-9b17-3b7e33852e05 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:40.166124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0e072cb2-547e-481e-9b17-3b7e33852e05 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:40.173876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e072cb2-547e-481e-9b17-3b7e33852e05 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.174442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e072cb2-547e-481e-9b17-3b7e33852e05 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.190828 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e072cb2-547e-481e-9b17-3b7e33852e05 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:40.190828 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e072cb2-547e-481e-9b17-3b7e33852e05 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.190828 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e072cb2-547e-481e-9b17-3b7e33852e05 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.190828 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e072cb2-547e-481e-9b17-3b7e33852e05 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:40.325242 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0e072cb2-547e-481e-9b17-3b7e33852e05 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:40.333754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0e072cb2-547e-481e-9b17-3b7e33852e05 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.171945 Sep 08 14:00:40.342269 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 68/133] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:40 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:40.558858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-253bbc61-b75c-44bc-b769-1b199b1ac4c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:40.559759 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-253bbc61-b75c-44bc-b769-1b199b1ac4c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:40.566999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253bbc61-b75c-44bc-b769-1b199b1ac4c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.567832 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253bbc61-b75c-44bc-b769-1b199b1ac4c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.568341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253bbc61-b75c-44bc-b769-1b199b1ac4c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:40.569151 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253bbc61-b75c-44bc-b769-1b199b1ac4c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.569671 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253bbc61-b75c-44bc-b769-1b199b1ac4c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.570195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253bbc61-b75c-44bc-b769-1b199b1ac4c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:40.597812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-24ff176f-450b-4567-acbd-5b8f6d63ad6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:40.598505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-24ff176f-450b-4567-acbd-5b8f6d63ad6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:40.604915 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-24ff176f-450b-4567-acbd-5b8f6d63ad6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.605395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-24ff176f-450b-4567-acbd-5b8f6d63ad6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.606067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-24ff176f-450b-4567-acbd-5b8f6d63ad6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:40.606859 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-24ff176f-450b-4567-acbd-5b8f6d63ad6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.607213 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-24ff176f-450b-4567-acbd-5b8f6d63ad6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.607841 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-24ff176f-450b-4567-acbd-5b8f6d63ad6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:40.742625 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-253bbc61-b75c-44bc-b769-1b199b1ac4c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:40.754038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-253bbc61-b75c-44bc-b769-1b199b1ac4c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.199820 Sep 08 14:00:40.755206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 66/134] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:40 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:40.757027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-24ff176f-450b-4567-acbd-5b8f6d63ad6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:40.766246 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-24ff176f-450b-4567-acbd-5b8f6d63ad6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.172494 Sep 08 14:00:40.767389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 69/135] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:40 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:40.935714 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fd0a809f-591b-4a01-b1b6-44080ff24a17 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:40.936358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-fd0a809f-591b-4a01-b1b6-44080ff24a17 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:40.942799 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd0a809f-591b-4a01-b1b6-44080ff24a17 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.943484 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd0a809f-591b-4a01-b1b6-44080ff24a17 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.943793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd0a809f-591b-4a01-b1b6-44080ff24a17 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:40.944583 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd0a809f-591b-4a01-b1b6-44080ff24a17 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.945040 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd0a809f-591b-4a01-b1b6-44080ff24a17 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.945465 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd0a809f-591b-4a01-b1b6-44080ff24a17 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.102756 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-fd0a809f-591b-4a01-b1b6-44080ff24a17 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:41.111260 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-fd0a809f-591b-4a01-b1b6-44080ff24a17 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.181303 Sep 08 14:00:41.111840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 67/136] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:40 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:41.368219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-32cfea4f-743c-4c4b-be69-06136aebbf1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:41.368219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-32cfea4f-743c-4c4b-be69-06136aebbf1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:41.368219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32cfea4f-743c-4c4b-be69-06136aebbf1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.368219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32cfea4f-743c-4c4b-be69-06136aebbf1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.368875 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32cfea4f-743c-4c4b-be69-06136aebbf1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.369135 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32cfea4f-743c-4c4b-be69-06136aebbf1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.370465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32cfea4f-743c-4c4b-be69-06136aebbf1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.371227 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32cfea4f-743c-4c4b-be69-06136aebbf1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.514067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-32cfea4f-743c-4c4b-be69-06136aebbf1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:41.518536 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-32cfea4f-743c-4c4b-be69-06136aebbf1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.165015 Sep 08 14:00:41.519362 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 70/137] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:41 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:41.780147 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ab903e57-2b5b-49e6-9bae-c98378198e07 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:41.781166 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ab903e57-2b5b-49e6-9bae-c98378198e07 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:41.786939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ab903e57-2b5b-49e6-9bae-c98378198e07 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.788014 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ab903e57-2b5b-49e6-9bae-c98378198e07 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.788014 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ab903e57-2b5b-49e6-9bae-c98378198e07 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.788640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ab903e57-2b5b-49e6-9bae-c98378198e07 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.789274 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ab903e57-2b5b-49e6-9bae-c98378198e07 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.789700 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5bea16e1-a451-4740-8fe9-80148175d1aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:41.789842 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ab903e57-2b5b-49e6-9bae-c98378198e07 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.790346 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5bea16e1-a451-4740-8fe9-80148175d1aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:41.796473 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bea16e1-a451-4740-8fe9-80148175d1aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.796955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bea16e1-a451-4740-8fe9-80148175d1aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.797388 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bea16e1-a451-4740-8fe9-80148175d1aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.798078 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bea16e1-a451-4740-8fe9-80148175d1aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.798532 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bea16e1-a451-4740-8fe9-80148175d1aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.798988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bea16e1-a451-4740-8fe9-80148175d1aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.959838 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ab903e57-2b5b-49e6-9bae-c98378198e07 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:41.971261 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ab903e57-2b5b-49e6-9bae-c98378198e07 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.195978 Sep 08 14:00:41.971519 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5bea16e1-a451-4740-8fe9-80148175d1aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:41.972559 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 68/138] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:41 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:41.980944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5bea16e1-a451-4740-8fe9-80148175d1aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.194397 Sep 08 14:00:41.981907 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 71/139] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:41 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:42.134211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-709c9b77-8ca1-4a3b-a2a3-2ea22524a5ac tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:42.134814 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-709c9b77-8ca1-4a3b-a2a3-2ea22524a5ac tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:42.141075 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-709c9b77-8ca1-4a3b-a2a3-2ea22524a5ac tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.141559 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-709c9b77-8ca1-4a3b-a2a3-2ea22524a5ac tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.141988 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-709c9b77-8ca1-4a3b-a2a3-2ea22524a5ac tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.143411 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-709c9b77-8ca1-4a3b-a2a3-2ea22524a5ac tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.143411 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-709c9b77-8ca1-4a3b-a2a3-2ea22524a5ac tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.143601 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-709c9b77-8ca1-4a3b-a2a3-2ea22524a5ac tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.311276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-709c9b77-8ca1-4a3b-a2a3-2ea22524a5ac tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:42.319446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-709c9b77-8ca1-4a3b-a2a3-2ea22524a5ac tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.188991 Sep 08 14:00:42.320089 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 69/140] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:42 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:42.542013 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e0e1e55e-e1ea-4d4d-aafc-3c22bf6eb734 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:42.542659 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e0e1e55e-e1ea-4d4d-aafc-3c22bf6eb734 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:42.549035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0e1e55e-e1ea-4d4d-aafc-3c22bf6eb734 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.549532 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0e1e55e-e1ea-4d4d-aafc-3c22bf6eb734 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.549951 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0e1e55e-e1ea-4d4d-aafc-3c22bf6eb734 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.550646 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0e1e55e-e1ea-4d4d-aafc-3c22bf6eb734 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.551129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0e1e55e-e1ea-4d4d-aafc-3c22bf6eb734 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.551546 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0e1e55e-e1ea-4d4d-aafc-3c22bf6eb734 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.555734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=100 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:42.731901 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e0e1e55e-e1ea-4d4d-aafc-3c22bf6eb734 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:42.740067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e0e1e55e-e1ea-4d4d-aafc-3c22bf6eb734 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.202190 Sep 08 14:00:42.740873 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 72/141] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:42 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:43.002826 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9d494e8a-b68c-4555-8cba-e03f57393ae8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:43.004054 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9d494e8a-b68c-4555-8cba-e03f57393ae8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:43.006198 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-85749b61-5819-44ab-aa02-79a1f495dfac tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:43.006463 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-85749b61-5819-44ab-aa02-79a1f495dfac tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:43.013832 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9d494e8a-b68c-4555-8cba-e03f57393ae8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.014437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9d494e8a-b68c-4555-8cba-e03f57393ae8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.015489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9d494e8a-b68c-4555-8cba-e03f57393ae8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.015934 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9d494e8a-b68c-4555-8cba-e03f57393ae8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.016454 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9d494e8a-b68c-4555-8cba-e03f57393ae8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.016853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9d494e8a-b68c-4555-8cba-e03f57393ae8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.018119 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85749b61-5819-44ab-aa02-79a1f495dfac tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.019020 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85749b61-5819-44ab-aa02-79a1f495dfac tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.019572 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85749b61-5819-44ab-aa02-79a1f495dfac tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.020694 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85749b61-5819-44ab-aa02-79a1f495dfac tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.021441 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85749b61-5819-44ab-aa02-79a1f495dfac tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.022097 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85749b61-5819-44ab-aa02-79a1f495dfac tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.210683 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-85749b61-5819-44ab-aa02-79a1f495dfac tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:43.221544 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-85749b61-5819-44ab-aa02-79a1f495dfac tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.218622 Sep 08 14:00:43.222726 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 73/142] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:43 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:43.246204 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9d494e8a-b68c-4555-8cba-e03f57393ae8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:43.255605 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9d494e8a-b68c-4555-8cba-e03f57393ae8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.256723 Sep 08 14:00:43.258868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 70/143] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:42 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:43.344643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-78ffdbc4-70c6-4bdf-84db-b688480bb849 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:43.345296 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-78ffdbc4-70c6-4bdf-84db-b688480bb849 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:43.356609 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-78ffdbc4-70c6-4bdf-84db-b688480bb849 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.362741 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-78ffdbc4-70c6-4bdf-84db-b688480bb849 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.364795 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-78ffdbc4-70c6-4bdf-84db-b688480bb849 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.370417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-78ffdbc4-70c6-4bdf-84db-b688480bb849 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.371283 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-78ffdbc4-70c6-4bdf-84db-b688480bb849 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.372517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-78ffdbc4-70c6-4bdf-84db-b688480bb849 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.647626 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-78ffdbc4-70c6-4bdf-84db-b688480bb849 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:43.662491 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-78ffdbc4-70c6-4bdf-84db-b688480bb849 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.319905 Sep 08 14:00:43.664862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 74/144] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:43 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:43.772040 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5d5b4033-4e49-4636-93f5-86b4040fa65b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:43.773189 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5d5b4033-4e49-4636-93f5-86b4040fa65b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:43.782071 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d5b4033-4e49-4636-93f5-86b4040fa65b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.782588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d5b4033-4e49-4636-93f5-86b4040fa65b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.783232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d5b4033-4e49-4636-93f5-86b4040fa65b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.783878 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d5b4033-4e49-4636-93f5-86b4040fa65b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.784361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d5b4033-4e49-4636-93f5-86b4040fa65b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.784965 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d5b4033-4e49-4636-93f5-86b4040fa65b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.987305 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5d5b4033-4e49-4636-93f5-86b4040fa65b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:43.998603 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5d5b4033-4e49-4636-93f5-86b4040fa65b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.232389 Sep 08 14:00:43.999562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 71/145] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:43 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:44.162060 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-1febbf4e-20b2-452c-9d1f-86781c58b86e req-98d24f5b-cccd-43dd-a1f3-858220b2a94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6194e5e-54c1-4f8b-a021-be476c67c25e", "name": "network-vif-plugged", "status": "completed", "tag": "e7a74814-4bc9-432b-b4e2-e2d33d383b16"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:44.180157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-1febbf4e-20b2-452c-9d1f-86781c58b86e req-98d24f5b-cccd-43dd-a1f3-858220b2a94a service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.180157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-1febbf4e-20b2-452c-9d1f-86781c58b86e req-98d24f5b-cccd-43dd-a1f3-858220b2a94a service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.184156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-1febbf4e-20b2-452c-9d1f-86781c58b86e req-98d24f5b-cccd-43dd-a1f3-858220b2a94a service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.216368 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-1febbf4e-20b2-452c-9d1f-86781c58b86e req-98d24f5b-cccd-43dd-a1f3-858220b2a94a service nova] Creating event network-vif-plugged:e7a74814-4bc9-432b-b4e2-e2d33d383b16 for instance e6194e5e-54c1-4f8b-a021-be476c67c25e on hv-cinder-84773 Sep 08 14:00:44.224829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-1febbf4e-20b2-452c-9d1f-86781c58b86e req-98d24f5b-cccd-43dd-a1f3-858220b2a94a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152725 Sep 08 14:00:44.225427 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 75/146] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:44.253234 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-253377ea-44a9-49c5-abd7-ef0e36419f16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:44.253851 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-253377ea-44a9-49c5-abd7-ef0e36419f16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:44.261258 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253377ea-44a9-49c5-abd7-ef0e36419f16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.262030 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253377ea-44a9-49c5-abd7-ef0e36419f16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.262675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253377ea-44a9-49c5-abd7-ef0e36419f16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.263732 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253377ea-44a9-49c5-abd7-ef0e36419f16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.264539 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253377ea-44a9-49c5-abd7-ef0e36419f16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.265447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-253377ea-44a9-49c5-abd7-ef0e36419f16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.289064 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4d702d41-e830-45db-ae18-baaa7a01bd8a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:44.290154 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4d702d41-e830-45db-ae18-baaa7a01bd8a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:44.300653 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d702d41-e830-45db-ae18-baaa7a01bd8a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.312455 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d702d41-e830-45db-ae18-baaa7a01bd8a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.312928 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d702d41-e830-45db-ae18-baaa7a01bd8a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.313669 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d702d41-e830-45db-ae18-baaa7a01bd8a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.314126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d702d41-e830-45db-ae18-baaa7a01bd8a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.314545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d702d41-e830-45db-ae18-baaa7a01bd8a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.500036 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-253377ea-44a9-49c5-abd7-ef0e36419f16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:44.508864 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-253377ea-44a9-49c5-abd7-ef0e36419f16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.259640 Sep 08 14:00:44.509717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 72/147] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:44 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:44.623201 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4d702d41-e830-45db-ae18-baaa7a01bd8a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:44.633134 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4d702d41-e830-45db-ae18-baaa7a01bd8a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.348301 Sep 08 14:00:44.633718 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 76/148] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:44 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:44.701401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-51a58075-6624-4cea-8fd9-97b469e9c605 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:44.702158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-51a58075-6624-4cea-8fd9-97b469e9c605 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:44.710807 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-51a58075-6624-4cea-8fd9-97b469e9c605 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.711550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-51a58075-6624-4cea-8fd9-97b469e9c605 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.712192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-51a58075-6624-4cea-8fd9-97b469e9c605 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.713137 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-51a58075-6624-4cea-8fd9-97b469e9c605 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.713815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-51a58075-6624-4cea-8fd9-97b469e9c605 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.714387 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-51a58075-6624-4cea-8fd9-97b469e9c605 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.747031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:44.913281 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-51a58075-6624-4cea-8fd9-97b469e9c605 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:44.943829 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-51a58075-6624-4cea-8fd9-97b469e9c605 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.236902 Sep 08 14:00:44.943829 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 73/149] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:44 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:45.022315 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-854b19c9-2549-47ad-9d30-045e47e81ff7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:45.023604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-854b19c9-2549-47ad-9d30-045e47e81ff7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:45.032776 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-854b19c9-2549-47ad-9d30-045e47e81ff7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.032776 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-854b19c9-2549-47ad-9d30-045e47e81ff7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.032776 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-854b19c9-2549-47ad-9d30-045e47e81ff7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.033460 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-854b19c9-2549-47ad-9d30-045e47e81ff7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.034084 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-854b19c9-2549-47ad-9d30-045e47e81ff7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.035495 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-854b19c9-2549-47ad-9d30-045e47e81ff7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.177729 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-854b19c9-2549-47ad-9d30-045e47e81ff7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:45.188252 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-854b19c9-2549-47ad-9d30-045e47e81ff7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.170271 Sep 08 14:00:45.188851 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 77/150] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:45 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:45.540992 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ed2651d1-bda8-4074-ab13-da92b4685353 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:45.540992 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ed2651d1-bda8-4074-ab13-da92b4685353 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:45.551399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed2651d1-bda8-4074-ab13-da92b4685353 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.551896 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed2651d1-bda8-4074-ab13-da92b4685353 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.553922 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed2651d1-bda8-4074-ab13-da92b4685353 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.554653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed2651d1-bda8-4074-ab13-da92b4685353 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.555134 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed2651d1-bda8-4074-ab13-da92b4685353 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.555734 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed2651d1-bda8-4074-ab13-da92b4685353 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.658795 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f0cf5635-4c3e-415d-ad47-ad655f10721c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:45.659555 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f0cf5635-4c3e-415d-ad47-ad655f10721c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:45.675686 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0cf5635-4c3e-415d-ad47-ad655f10721c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.676273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0cf5635-4c3e-415d-ad47-ad655f10721c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.677496 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0cf5635-4c3e-415d-ad47-ad655f10721c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.680890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0cf5635-4c3e-415d-ad47-ad655f10721c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.684911 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0cf5635-4c3e-415d-ad47-ad655f10721c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.685359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0cf5635-4c3e-415d-ad47-ad655f10721c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.754957 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ed2651d1-bda8-4074-ab13-da92b4685353 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:45.767616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ed2651d1-bda8-4074-ab13-da92b4685353 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.236375 Sep 08 14:00:45.768314 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 74/151] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:45 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:45.871190 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f0cf5635-4c3e-415d-ad47-ad655f10721c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:45.879704 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f0cf5635-4c3e-415d-ad47-ad655f10721c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.225202 Sep 08 14:00:45.881025 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 78/152] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:45 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:45.954382 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6954fed8-aacc-4564-a004-1d20055e64f6 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:45.955138 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6954fed8-aacc-4564-a004-1d20055e64f6 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:45.956973 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:45.961964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6954fed8-aacc-4564-a004-1d20055e64f6 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.962457 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6954fed8-aacc-4564-a004-1d20055e64f6 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.962931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6954fed8-aacc-4564-a004-1d20055e64f6 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.963770 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6954fed8-aacc-4564-a004-1d20055e64f6 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.964221 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6954fed8-aacc-4564-a004-1d20055e64f6 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.964648 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6954fed8-aacc-4564-a004-1d20055e64f6 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:46.117150 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6954fed8-aacc-4564-a004-1d20055e64f6 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:46.125994 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6954fed8-aacc-4564-a004-1d20055e64f6 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.175800 Sep 08 14:00:46.127403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 75/153] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:45 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:46.213515 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2c0dfbbe-e6df-427d-95a0-d415b3e43781 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:46.214175 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2c0dfbbe-e6df-427d-95a0-d415b3e43781 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:46.220260 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2c0dfbbe-e6df-427d-95a0-d415b3e43781 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.220731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2c0dfbbe-e6df-427d-95a0-d415b3e43781 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.221153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2c0dfbbe-e6df-427d-95a0-d415b3e43781 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:46.221832 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2c0dfbbe-e6df-427d-95a0-d415b3e43781 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.222279 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2c0dfbbe-e6df-427d-95a0-d415b3e43781 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.222695 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2c0dfbbe-e6df-427d-95a0-d415b3e43781 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:46.240100 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-2fcae3ef-fe31-49f7-8ca8-baffa628604d req-d6b38b63-f546-4dd3-a089-82380c7c77c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e409e9dd-aae7-4cce-9c1f-2c449abf9093", "name": "network-vif-plugged", "status": "completed", "tag": "58bdc1ca-5bc3-4026-a9e9-b7ad9f7ea1da"}, {"server_uuid": "bf2e3658-e4d5-4914-8e30-b3e710cdb935", "name": "network-vif-plugged", "status": "completed", "tag": "ea3bc6ce-56d5-4aa4-8ae0-4ec904dc93e2"}, {"server_uuid": "edd10060-2469-49e3-a8c3-949a359181f8", "name": "network-vif-plugged", "status": "completed", "tag": "5a142423-c154-4b43-a8f8-2a5d3c52910e"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:46.255574 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2fcae3ef-fe31-49f7-8ca8-baffa628604d req-d6b38b63-f546-4dd3-a089-82380c7c77c0 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.256161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2fcae3ef-fe31-49f7-8ca8-baffa628604d req-d6b38b63-f546-4dd3-a089-82380c7c77c0 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.256680 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2fcae3ef-fe31-49f7-8ca8-baffa628604d req-d6b38b63-f546-4dd3-a089-82380c7c77c0 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:46.272521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-2fcae3ef-fe31-49f7-8ca8-baffa628604d req-d6b38b63-f546-4dd3-a089-82380c7c77c0 service nova] Creating event network-vif-plugged:58bdc1ca-5bc3-4026-a9e9-b7ad9f7ea1da for instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 on hv-cinder-84773 Sep 08 14:00:46.273031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-2fcae3ef-fe31-49f7-8ca8-baffa628604d req-d6b38b63-f546-4dd3-a089-82380c7c77c0 service nova] Creating event network-vif-plugged:ea3bc6ce-56d5-4aa4-8ae0-4ec904dc93e2 for instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 on hv-cinder-84773 Sep 08 14:00:46.273600 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-2fcae3ef-fe31-49f7-8ca8-baffa628604d req-d6b38b63-f546-4dd3-a089-82380c7c77c0 service nova] Creating event network-vif-plugged:5a142423-c154-4b43-a8f8-2a5d3c52910e for instance edd10060-2469-49e3-a8c3-949a359181f8 on hv-cinder-84773 Sep 08 14:00:46.286419 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-2fcae3ef-fe31-49f7-8ca8-baffa628604d req-d6b38b63-f546-4dd3-a089-82380c7c77c0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.049952 Sep 08 14:00:46.287363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 76/154] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:00:46.380220 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2c0dfbbe-e6df-427d-95a0-d415b3e43781 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:46.388847 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2c0dfbbe-e6df-427d-95a0-d415b3e43781 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.179864 Sep 08 14:00:46.389463 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 79/155] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:46 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:46.796844 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-872a46da-1206-4201-a8d9-ea9d31a9d396 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:46.797617 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-872a46da-1206-4201-a8d9-ea9d31a9d396 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:46.805433 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-872a46da-1206-4201-a8d9-ea9d31a9d396 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.806169 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-872a46da-1206-4201-a8d9-ea9d31a9d396 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.806788 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-872a46da-1206-4201-a8d9-ea9d31a9d396 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:46.808287 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-872a46da-1206-4201-a8d9-ea9d31a9d396 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.808901 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-872a46da-1206-4201-a8d9-ea9d31a9d396 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.809320 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-872a46da-1206-4201-a8d9-ea9d31a9d396 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:46.907794 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-03e94fcb-857c-46fa-b346-e4a852b7a9dd tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:46.909065 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-03e94fcb-857c-46fa-b346-e4a852b7a9dd tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:46.915977 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03e94fcb-857c-46fa-b346-e4a852b7a9dd tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.916523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03e94fcb-857c-46fa-b346-e4a852b7a9dd tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.916981 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03e94fcb-857c-46fa-b346-e4a852b7a9dd tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:46.917689 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03e94fcb-857c-46fa-b346-e4a852b7a9dd tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.918144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03e94fcb-857c-46fa-b346-e4a852b7a9dd tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.918568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03e94fcb-857c-46fa-b346-e4a852b7a9dd tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:47.092363 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-03e94fcb-857c-46fa-b346-e4a852b7a9dd tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:47.111093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-03e94fcb-857c-46fa-b346-e4a852b7a9dd tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.208905 Sep 08 14:00:47.111957 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 80/156] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:46 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:47.151749 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f54ce086-4aef-4016-b4a6-0fdc0c22e67f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:47.152362 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f54ce086-4aef-4016-b4a6-0fdc0c22e67f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:47.159658 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f54ce086-4aef-4016-b4a6-0fdc0c22e67f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:47.160155 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f54ce086-4aef-4016-b4a6-0fdc0c22e67f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:47.160600 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f54ce086-4aef-4016-b4a6-0fdc0c22e67f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:47.161346 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f54ce086-4aef-4016-b4a6-0fdc0c22e67f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:47.162103 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f54ce086-4aef-4016-b4a6-0fdc0c22e67f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:47.162519 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f54ce086-4aef-4016-b4a6-0fdc0c22e67f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:47.211194 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-872a46da-1206-4201-a8d9-ea9d31a9d396 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:47.219804 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-872a46da-1206-4201-a8d9-ea9d31a9d396 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.427367 Sep 08 14:00:47.221152 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 77/157] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:46 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:47.338301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f54ce086-4aef-4016-b4a6-0fdc0c22e67f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:47.348187 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f54ce086-4aef-4016-b4a6-0fdc0c22e67f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.201818 Sep 08 14:00:47.349097 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 81/158] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:47 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:47.413460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-979b96f6-e4f7-4db4-bda2-b9048ca48ee1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:47.414840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-979b96f6-e4f7-4db4-bda2-b9048ca48ee1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:47.424033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-979b96f6-e4f7-4db4-bda2-b9048ca48ee1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:47.424645 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-979b96f6-e4f7-4db4-bda2-b9048ca48ee1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:47.425081 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-979b96f6-e4f7-4db4-bda2-b9048ca48ee1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:47.425815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-979b96f6-e4f7-4db4-bda2-b9048ca48ee1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:47.426271 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-979b96f6-e4f7-4db4-bda2-b9048ca48ee1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:47.426691 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-979b96f6-e4f7-4db4-bda2-b9048ca48ee1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:47.580355 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-979b96f6-e4f7-4db4-bda2-b9048ca48ee1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:47.590024 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-979b96f6-e4f7-4db4-bda2-b9048ca48ee1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.181134 Sep 08 14:00:47.590627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 78/159] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:47 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:48.137582 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2812bec1-dfa7-4266-84ed-8814c074513f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:48.138199 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2812bec1-dfa7-4266-84ed-8814c074513f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:48.144268 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2812bec1-dfa7-4266-84ed-8814c074513f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.144746 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2812bec1-dfa7-4266-84ed-8814c074513f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.145170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2812bec1-dfa7-4266-84ed-8814c074513f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.145873 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2812bec1-dfa7-4266-84ed-8814c074513f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.146348 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2812bec1-dfa7-4266-84ed-8814c074513f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.146810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2812bec1-dfa7-4266-84ed-8814c074513f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.244051 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-43648418-f98c-4928-92f3-7684f5e1a660 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:48.245062 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-43648418-f98c-4928-92f3-7684f5e1a660 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:48.251761 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-43648418-f98c-4928-92f3-7684f5e1a660 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.252243 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-43648418-f98c-4928-92f3-7684f5e1a660 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.252700 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-43648418-f98c-4928-92f3-7684f5e1a660 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.253393 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-43648418-f98c-4928-92f3-7684f5e1a660 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.253846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-43648418-f98c-4928-92f3-7684f5e1a660 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.254268 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-43648418-f98c-4928-92f3-7684f5e1a660 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.292142 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2812bec1-dfa7-4266-84ed-8814c074513f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:48.300758 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2812bec1-dfa7-4266-84ed-8814c074513f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.168391 Sep 08 14:00:48.301389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 82/160] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:48 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:48.372009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2bf1fc3b-d6bb-4db3-8508-e11267531d49 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:48.373670 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2bf1fc3b-d6bb-4db3-8508-e11267531d49 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:48.380516 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bf1fc3b-d6bb-4db3-8508-e11267531d49 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.381231 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bf1fc3b-d6bb-4db3-8508-e11267531d49 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.381841 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bf1fc3b-d6bb-4db3-8508-e11267531d49 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.382875 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bf1fc3b-d6bb-4db3-8508-e11267531d49 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.383519 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bf1fc3b-d6bb-4db3-8508-e11267531d49 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.385679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bf1fc3b-d6bb-4db3-8508-e11267531d49 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.402616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-43648418-f98c-4928-92f3-7684f5e1a660 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:48.410413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-43648418-f98c-4928-92f3-7684f5e1a660 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.170609 Sep 08 14:00:48.414400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 79/161] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:48 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:48.542926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2bf1fc3b-d6bb-4db3-8508-e11267531d49 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:48.551060 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2bf1fc3b-d6bb-4db3-8508-e11267531d49 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.184430 Sep 08 14:00:48.551636 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 83/162] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:48 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:48.612204 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4947b95e-8930-456d-8fba-54e0037d56bb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:48.613113 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4947b95e-8930-456d-8fba-54e0037d56bb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:48.620965 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4947b95e-8930-456d-8fba-54e0037d56bb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.621195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4947b95e-8930-456d-8fba-54e0037d56bb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.621620 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4947b95e-8930-456d-8fba-54e0037d56bb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.622363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4947b95e-8930-456d-8fba-54e0037d56bb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.622865 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4947b95e-8930-456d-8fba-54e0037d56bb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.623389 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4947b95e-8930-456d-8fba-54e0037d56bb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.753300 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4947b95e-8930-456d-8fba-54e0037d56bb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:48.761794 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4947b95e-8930-456d-8fba-54e0037d56bb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.153543 Sep 08 14:00:48.762360 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 80/163] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:48 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:49.326055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8151bdf3-15ce-4d8e-b7bd-e743f1d57f2c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:49.326696 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8151bdf3-15ce-4d8e-b7bd-e743f1d57f2c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:49.332653 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8151bdf3-15ce-4d8e-b7bd-e743f1d57f2c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.333156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8151bdf3-15ce-4d8e-b7bd-e743f1d57f2c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.333563 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8151bdf3-15ce-4d8e-b7bd-e743f1d57f2c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.334261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8151bdf3-15ce-4d8e-b7bd-e743f1d57f2c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.334708 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8151bdf3-15ce-4d8e-b7bd-e743f1d57f2c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.335150 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8151bdf3-15ce-4d8e-b7bd-e743f1d57f2c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.435304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a596c183-b76f-469f-9d1d-5e8cdef3bd6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:49.436118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a596c183-b76f-469f-9d1d-5e8cdef3bd6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:49.443064 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a596c183-b76f-469f-9d1d-5e8cdef3bd6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.443579 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a596c183-b76f-469f-9d1d-5e8cdef3bd6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.444032 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a596c183-b76f-469f-9d1d-5e8cdef3bd6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.447010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a596c183-b76f-469f-9d1d-5e8cdef3bd6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.447010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a596c183-b76f-469f-9d1d-5e8cdef3bd6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.447010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a596c183-b76f-469f-9d1d-5e8cdef3bd6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.483027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8151bdf3-15ce-4d8e-b7bd-e743f1d57f2c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:49.484037 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8151bdf3-15ce-4d8e-b7bd-e743f1d57f2c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.161835 Sep 08 14:00:49.484458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 84/164] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:49 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:49.573826 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-bcad69b4-2735-47a8-85de-ed77e868290f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:49.574435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-bcad69b4-2735-47a8-85de-ed77e868290f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:49.580364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bcad69b4-2735-47a8-85de-ed77e868290f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.580845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bcad69b4-2735-47a8-85de-ed77e868290f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.581273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bcad69b4-2735-47a8-85de-ed77e868290f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.581969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bcad69b4-2735-47a8-85de-ed77e868290f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.582406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bcad69b4-2735-47a8-85de-ed77e868290f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.582823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bcad69b4-2735-47a8-85de-ed77e868290f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.594058 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a596c183-b76f-469f-9d1d-5e8cdef3bd6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:49.602211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a596c183-b76f-469f-9d1d-5e8cdef3bd6a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.172385 Sep 08 14:00:49.602816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 81/165] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:49 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:49.829245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-bcad69b4-2735-47a8-85de-ed77e868290f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:49.829245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-bcad69b4-2735-47a8-85de-ed77e868290f tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.153128 Sep 08 14:00:49.829245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 85/166] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:49 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:49.830150 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3858a04f-e1b6-43f7-8868-3c9fdd0cba96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:49.830150 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3858a04f-e1b6-43f7-8868-3c9fdd0cba96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:49.830150 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3858a04f-e1b6-43f7-8868-3c9fdd0cba96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.830150 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3858a04f-e1b6-43f7-8868-3c9fdd0cba96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.830474 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3858a04f-e1b6-43f7-8868-3c9fdd0cba96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.830474 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3858a04f-e1b6-43f7-8868-3c9fdd0cba96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.830474 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3858a04f-e1b6-43f7-8868-3c9fdd0cba96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.830474 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3858a04f-e1b6-43f7-8868-3c9fdd0cba96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.928856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3858a04f-e1b6-43f7-8868-3c9fdd0cba96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:49.937169 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3858a04f-e1b6-43f7-8868-3c9fdd0cba96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.155827 Sep 08 14:00:49.937736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 82/167] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:49 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:50.584220 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-eeff0575-9aa7-4ce2-b629-e527b5a3b89f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:50.584220 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-eeff0575-9aa7-4ce2-b629-e527b5a3b89f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:50.584220 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eeff0575-9aa7-4ce2-b629-e527b5a3b89f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:50.584220 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eeff0575-9aa7-4ce2-b629-e527b5a3b89f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:50.585673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eeff0575-9aa7-4ce2-b629-e527b5a3b89f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:50.585673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eeff0575-9aa7-4ce2-b629-e527b5a3b89f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:50.585673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eeff0575-9aa7-4ce2-b629-e527b5a3b89f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:50.585673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eeff0575-9aa7-4ce2-b629-e527b5a3b89f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:50.627601 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3a810729-1bff-4d24-92a8-51154d9c5a8e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:50.629760 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3a810729-1bff-4d24-92a8-51154d9c5a8e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:50.636853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a810729-1bff-4d24-92a8-51154d9c5a8e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:50.637436 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a810729-1bff-4d24-92a8-51154d9c5a8e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:50.637935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a810729-1bff-4d24-92a8-51154d9c5a8e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:50.638855 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a810729-1bff-4d24-92a8-51154d9c5a8e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:50.639404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a810729-1bff-4d24-92a8-51154d9c5a8e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:50.639894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a810729-1bff-4d24-92a8-51154d9c5a8e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:50.744150 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-eeff0575-9aa7-4ce2-b629-e527b5a3b89f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:50.752484 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-eeff0575-9aa7-4ce2-b629-e527b5a3b89f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1363 microversion: 2.1 time: 0.248618 Sep 08 14:00:50.753053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 86/168] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:50 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:50.780258 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3a810729-1bff-4d24-92a8-51154d9c5a8e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:50.788496 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3a810729-1bff-4d24-92a8-51154d9c5a8e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.165939 Sep 08 14:00:50.789069 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 83/169] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:50 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:50.850866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f8c64a64-309e-4c47-8a04-8e759568e6a2 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:50.851415 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f8c64a64-309e-4c47-8a04-8e759568e6a2 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:50.857859 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8c64a64-309e-4c47-8a04-8e759568e6a2 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:50.858337 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8c64a64-309e-4c47-8a04-8e759568e6a2 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:50.858765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8c64a64-309e-4c47-8a04-8e759568e6a2 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:50.859467 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8c64a64-309e-4c47-8a04-8e759568e6a2 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:50.859916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8c64a64-309e-4c47-8a04-8e759568e6a2 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:50.860332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8c64a64-309e-4c47-8a04-8e759568e6a2 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:50.960590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-28e52058-ca24-41f3-8ce2-196ffcaae1e7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:50.961330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-28e52058-ca24-41f3-8ce2-196ffcaae1e7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:50.968179 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-28e52058-ca24-41f3-8ce2-196ffcaae1e7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:50.968735 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-28e52058-ca24-41f3-8ce2-196ffcaae1e7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:50.969180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-28e52058-ca24-41f3-8ce2-196ffcaae1e7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:50.969882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-28e52058-ca24-41f3-8ce2-196ffcaae1e7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:50.970334 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-28e52058-ca24-41f3-8ce2-196ffcaae1e7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:50.970755 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-28e52058-ca24-41f3-8ce2-196ffcaae1e7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.000446 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f8c64a64-309e-4c47-8a04-8e759568e6a2 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:51.009010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f8c64a64-309e-4c47-8a04-8e759568e6a2 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.162162 Sep 08 14:00:51.009588 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 87/170] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:50 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:51.118256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-28e52058-ca24-41f3-8ce2-196ffcaae1e7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:51.126440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-28e52058-ca24-41f3-8ce2-196ffcaae1e7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.170621 Sep 08 14:00:51.127646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 84/171] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:50 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:51.155420 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-bdae9ad8-b1e6-4bbc-a5ee-b1a3704ff6fb req-e40c3075-69bc-4eca-8436-87d76609f726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669cbb96-aa6a-43b6-b943-3d6ffef440c7", "name": "network-vif-plugged", "status": "completed", "tag": "826f910d-daa7-494d-a27b-a16e5794deab"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:51.164875 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-bdae9ad8-b1e6-4bbc-a5ee-b1a3704ff6fb req-e40c3075-69bc-4eca-8436-87d76609f726 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.165353 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-bdae9ad8-b1e6-4bbc-a5ee-b1a3704ff6fb req-e40c3075-69bc-4eca-8436-87d76609f726 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.165805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-bdae9ad8-b1e6-4bbc-a5ee-b1a3704ff6fb req-e40c3075-69bc-4eca-8436-87d76609f726 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.176755 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-bdae9ad8-b1e6-4bbc-a5ee-b1a3704ff6fb req-e40c3075-69bc-4eca-8436-87d76609f726 service nova] Creating event network-vif-plugged:826f910d-daa7-494d-a27b-a16e5794deab for instance 669cbb96-aa6a-43b6-b943-3d6ffef440c7 on hv-cinder-84773 Sep 08 14:00:51.181747 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-bdae9ad8-b1e6-4bbc-a5ee-b1a3704ff6fb req-e40c3075-69bc-4eca-8436-87d76609f726 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031081 Sep 08 14:00:51.182830 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 88/172] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:00:51.777834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-af84a371-0a4d-4726-84ae-06a9af1fdacf tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:51.778483 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-af84a371-0a4d-4726-84ae-06a9af1fdacf tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:51.784348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-af84a371-0a4d-4726-84ae-06a9af1fdacf tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.784834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-af84a371-0a4d-4726-84ae-06a9af1fdacf tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.785267 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-af84a371-0a4d-4726-84ae-06a9af1fdacf tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.785949 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-af84a371-0a4d-4726-84ae-06a9af1fdacf tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.786404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-af84a371-0a4d-4726-84ae-06a9af1fdacf tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.786819 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-af84a371-0a4d-4726-84ae-06a9af1fdacf tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.812550 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3c7ffa04-7387-4b99-921c-35530ca738f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:51.813248 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3c7ffa04-7387-4b99-921c-35530ca738f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:51.816646 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=100 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:51.820588 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7ffa04-7387-4b99-921c-35530ca738f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.821081 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7ffa04-7387-4b99-921c-35530ca738f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.821511 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7ffa04-7387-4b99-921c-35530ca738f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.822203 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7ffa04-7387-4b99-921c-35530ca738f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.822905 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7ffa04-7387-4b99-921c-35530ca738f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.823507 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3c7ffa04-7387-4b99-921c-35530ca738f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.925567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-af84a371-0a4d-4726-84ae-06a9af1fdacf tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:51.934349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-af84a371-0a4d-4726-84ae-06a9af1fdacf tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1550 microversion: 2.1 time: 0.160563 Sep 08 14:00:51.935330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 85/173] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:51 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:51.962072 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0fd82ef2-5e66-4b87-8fc6-667cc0591df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:51.962072 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0fd82ef2-5e66-4b87-8fc6-667cc0591df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:51.962820 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3c7ffa04-7387-4b99-921c-35530ca738f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:51.966564 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0fd82ef2-5e66-4b87-8fc6-667cc0591df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.967090 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0fd82ef2-5e66-4b87-8fc6-667cc0591df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.967884 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0fd82ef2-5e66-4b87-8fc6-667cc0591df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.968582 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0fd82ef2-5e66-4b87-8fc6-667cc0591df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.969036 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0fd82ef2-5e66-4b87-8fc6-667cc0591df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.969479 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0fd82ef2-5e66-4b87-8fc6-667cc0591df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.971367 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3c7ffa04-7387-4b99-921c-35530ca738f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.163102 Sep 08 14:00:51.974966 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 89/174] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:51 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:52.031861 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2e6425cc-65a3-4de8-b11a-05e499ce0ac5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:52.032453 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2e6425cc-65a3-4de8-b11a-05e499ce0ac5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:52.038192 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e6425cc-65a3-4de8-b11a-05e499ce0ac5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:52.038670 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e6425cc-65a3-4de8-b11a-05e499ce0ac5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:52.039126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e6425cc-65a3-4de8-b11a-05e499ce0ac5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:52.039808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e6425cc-65a3-4de8-b11a-05e499ce0ac5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:52.040250 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e6425cc-65a3-4de8-b11a-05e499ce0ac5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:52.040663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e6425cc-65a3-4de8-b11a-05e499ce0ac5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:52.044762 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=100 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:52.095065 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0fd82ef2-5e66-4b87-8fc6-667cc0591df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140386 Sep 08 14:00:52.095698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 86/175] 10.222.0.91 () {58 vars in 1275 bytes} [Thu Sep 8 14:00:51 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:00:52.150939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8857c2c1-7ddb-4f8a-af78-653193bd0125 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:52.151917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8857c2c1-7ddb-4f8a-af78-653193bd0125 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:52.159479 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8857c2c1-7ddb-4f8a-af78-653193bd0125 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:52.160197 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8857c2c1-7ddb-4f8a-af78-653193bd0125 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:52.160854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8857c2c1-7ddb-4f8a-af78-653193bd0125 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:52.161736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8857c2c1-7ddb-4f8a-af78-653193bd0125 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:52.162474 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8857c2c1-7ddb-4f8a-af78-653193bd0125 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:52.162987 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8857c2c1-7ddb-4f8a-af78-653193bd0125 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:52.191505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2e6425cc-65a3-4de8-b11a-05e499ce0ac5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:52.200204 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2e6425cc-65a3-4de8-b11a-05e499ce0ac5 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1315 microversion: 2.1 time: 0.172152 Sep 08 14:00:52.200776 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 90/176] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:52 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:52.472305 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8857c2c1-7ddb-4f8a-af78-653193bd0125 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:52.483905 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8857c2c1-7ddb-4f8a-af78-653193bd0125 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.337957 Sep 08 14:00:52.485139 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 87/177] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:52 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:52.993822 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ae1cc92e-e290-4e90-964b-772ab507c225 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:52.994966 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ae1cc92e-e290-4e90-964b-772ab507c225 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:53.000762 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae1cc92e-e290-4e90-964b-772ab507c225 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.001620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae1cc92e-e290-4e90-964b-772ab507c225 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.001742 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae1cc92e-e290-4e90-964b-772ab507c225 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.002328 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae1cc92e-e290-4e90-964b-772ab507c225 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.002979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae1cc92e-e290-4e90-964b-772ab507c225 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.003400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae1cc92e-e290-4e90-964b-772ab507c225 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.138503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ae1cc92e-e290-4e90-964b-772ab507c225 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:53.147673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ae1cc92e-e290-4e90-964b-772ab507c225 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.157555 Sep 08 14:00:53.148258 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 91/178] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:52 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:53.223616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5d4112b5-a614-4278-aa66-5f443236935d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:53.224165 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5d4112b5-a614-4278-aa66-5f443236935d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:53.231338 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d4112b5-a614-4278-aa66-5f443236935d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.231838 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d4112b5-a614-4278-aa66-5f443236935d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.232303 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d4112b5-a614-4278-aa66-5f443236935d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.233982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d4112b5-a614-4278-aa66-5f443236935d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.233982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d4112b5-a614-4278-aa66-5f443236935d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.233982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5d4112b5-a614-4278-aa66-5f443236935d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.473020 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5d4112b5-a614-4278-aa66-5f443236935d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:53.484003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5d4112b5-a614-4278-aa66-5f443236935d tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1502 microversion: 2.1 time: 0.262394 Sep 08 14:00:53.484003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 88/179] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:53 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:53.512696 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c672f668-3ef0-4d8e-b7b4-b7a5fdd056ef tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:53.513104 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c672f668-3ef0-4d8e-b7b4-b7a5fdd056ef tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:53.518965 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c672f668-3ef0-4d8e-b7b4-b7a5fdd056ef tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.519671 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c672f668-3ef0-4d8e-b7b4-b7a5fdd056ef tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.520350 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c672f668-3ef0-4d8e-b7b4-b7a5fdd056ef tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.521195 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c672f668-3ef0-4d8e-b7b4-b7a5fdd056ef tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.521787 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c672f668-3ef0-4d8e-b7b4-b7a5fdd056ef tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.522336 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c672f668-3ef0-4d8e-b7b4-b7a5fdd056ef tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.694358 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c672f668-3ef0-4d8e-b7b4-b7a5fdd056ef tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:53.705571 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c672f668-3ef0-4d8e-b7b4-b7a5fdd056ef tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.201773 Sep 08 14:00:53.710019 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 92/180] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:53 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:53.880888 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-de8eb9cf-df44-4b45-b429-7913a3dccfe3 req-417061be-8224-4009-97f1-f4850efedb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6194e5e-54c1-4f8b-a021-be476c67c25e", "tag": "e7a74814-4bc9-432b-b4e2-e2d33d383b16"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:53.891672 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-de8eb9cf-df44-4b45-b429-7913a3dccfe3 req-417061be-8224-4009-97f1-f4850efedb01 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.892381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-de8eb9cf-df44-4b45-b429-7913a3dccfe3 req-417061be-8224-4009-97f1-f4850efedb01 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.893073 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-de8eb9cf-df44-4b45-b429-7913a3dccfe3 req-417061be-8224-4009-97f1-f4850efedb01 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.905404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-de8eb9cf-df44-4b45-b429-7913a3dccfe3 req-417061be-8224-4009-97f1-f4850efedb01 service nova] Creating event network-changed:e7a74814-4bc9-432b-b4e2-e2d33d383b16 for instance e6194e5e-54c1-4f8b-a021-be476c67c25e on hv-cinder-84773 Sep 08 14:00:53.912341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-de8eb9cf-df44-4b45-b429-7913a3dccfe3 req-417061be-8224-4009-97f1-f4850efedb01 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035279 Sep 08 14:00:53.916193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 89/181] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:54.173859 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a6825dfd-2b55-4f33-917a-8e50d9cebe9a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:54.174456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a6825dfd-2b55-4f33-917a-8e50d9cebe9a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:54.181894 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a6825dfd-2b55-4f33-917a-8e50d9cebe9a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:54.182448 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a6825dfd-2b55-4f33-917a-8e50d9cebe9a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:54.183545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a6825dfd-2b55-4f33-917a-8e50d9cebe9a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.184049 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a6825dfd-2b55-4f33-917a-8e50d9cebe9a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:54.184581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a6825dfd-2b55-4f33-917a-8e50d9cebe9a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:54.185077 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a6825dfd-2b55-4f33-917a-8e50d9cebe9a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.364331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a6825dfd-2b55-4f33-917a-8e50d9cebe9a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:54.369999 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a6825dfd-2b55-4f33-917a-8e50d9cebe9a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1368 microversion: 2.1 time: 0.201901 Sep 08 14:00:54.370568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 93/182] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:54 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:54.735631 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-95ff4afa-31e9-419b-9a85-68b88eca1c16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:54.735631 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-95ff4afa-31e9-419b-9a85-68b88eca1c16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:54.748091 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-95ff4afa-31e9-419b-9a85-68b88eca1c16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:54.748592 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-95ff4afa-31e9-419b-9a85-68b88eca1c16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:54.749154 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-95ff4afa-31e9-419b-9a85-68b88eca1c16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.749868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-95ff4afa-31e9-419b-9a85-68b88eca1c16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:54.750327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-95ff4afa-31e9-419b-9a85-68b88eca1c16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:54.750812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-95ff4afa-31e9-419b-9a85-68b88eca1c16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.905927 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-95ff4afa-31e9-419b-9a85-68b88eca1c16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:54.914275 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-95ff4afa-31e9-419b-9a85-68b88eca1c16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.185578 Sep 08 14:00:54.914854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 90/183] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:54 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:55.394133 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c65164b7-9d8c-4957-bfc2-7215fd63f01d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:55.394852 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c65164b7-9d8c-4957-bfc2-7215fd63f01d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:55.402248 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c65164b7-9d8c-4957-bfc2-7215fd63f01d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:55.405486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c65164b7-9d8c-4957-bfc2-7215fd63f01d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:55.405486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c65164b7-9d8c-4957-bfc2-7215fd63f01d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:55.405486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c65164b7-9d8c-4957-bfc2-7215fd63f01d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:55.405486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c65164b7-9d8c-4957-bfc2-7215fd63f01d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:55.405831 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c65164b7-9d8c-4957-bfc2-7215fd63f01d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:55.538319 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c65164b7-9d8c-4957-bfc2-7215fd63f01d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:55.546182 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c65164b7-9d8c-4957-bfc2-7215fd63f01d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1558 microversion: 2.1 time: 0.156968 Sep 08 14:00:55.546745 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 94/184] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:55 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:55.569277 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f7806295-e431-4b83-b84e-f9968dfc3aa2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:55.571628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f7806295-e431-4b83-b84e-f9968dfc3aa2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:55.576333 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7806295-e431-4b83-b84e-f9968dfc3aa2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:55.576812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7806295-e431-4b83-b84e-f9968dfc3aa2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:55.577244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7806295-e431-4b83-b84e-f9968dfc3aa2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:55.577929 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7806295-e431-4b83-b84e-f9968dfc3aa2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:55.578373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7806295-e431-4b83-b84e-f9968dfc3aa2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:55.578785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7806295-e431-4b83-b84e-f9968dfc3aa2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:55.657181 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f7806295-e431-4b83-b84e-f9968dfc3aa2 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091781 Sep 08 14:00:55.657771 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 91/185] 10.222.0.91 () {58 vars in 1275 bytes} [Thu Sep 8 14:00:55 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:55.943842 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ef3b5f63-33ce-4cd0-a6e8-03614acaeaf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:55.944743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ef3b5f63-33ce-4cd0-a6e8-03614acaeaf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:55.952141 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ef3b5f63-33ce-4cd0-a6e8-03614acaeaf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:55.952636 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ef3b5f63-33ce-4cd0-a6e8-03614acaeaf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:55.953093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ef3b5f63-33ce-4cd0-a6e8-03614acaeaf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:55.953785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ef3b5f63-33ce-4cd0-a6e8-03614acaeaf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:55.954237 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ef3b5f63-33ce-4cd0-a6e8-03614acaeaf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:55.954659 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ef3b5f63-33ce-4cd0-a6e8-03614acaeaf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:56.095396 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ef3b5f63-33ce-4cd0-a6e8-03614acaeaf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:56.103301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ef3b5f63-33ce-4cd0-a6e8-03614acaeaf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.163153 Sep 08 14:00:56.108907 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 95/186] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:55 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:56.722237 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-06440d3f-0bc3-4313-a69f-1086a09dc826 req-4e804377-55ff-47f0-9db9-5f150be571d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd10060-2469-49e3-a8c3-949a359181f8", "tag": "5a142423-c154-4b43-a8f8-2a5d3c52910e"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:56.733034 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-06440d3f-0bc3-4313-a69f-1086a09dc826 req-4e804377-55ff-47f0-9db9-5f150be571d8 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:56.733200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-06440d3f-0bc3-4313-a69f-1086a09dc826 req-4e804377-55ff-47f0-9db9-5f150be571d8 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:56.733632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-06440d3f-0bc3-4313-a69f-1086a09dc826 req-4e804377-55ff-47f0-9db9-5f150be571d8 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:56.737760 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:56.747079 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-06440d3f-0bc3-4313-a69f-1086a09dc826 req-4e804377-55ff-47f0-9db9-5f150be571d8 service nova] Creating event network-changed:5a142423-c154-4b43-a8f8-2a5d3c52910e for instance edd10060-2469-49e3-a8c3-949a359181f8 on hv-cinder-84773 Sep 08 14:00:56.752182 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-06440d3f-0bc3-4313-a69f-1086a09dc826 req-4e804377-55ff-47f0-9db9-5f150be571d8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033683 Sep 08 14:00:56.752779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 92/187] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:57.126035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-270cbcee-87d6-4136-a2cf-ad3aa8d25e2e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:57.126849 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-270cbcee-87d6-4136-a2cf-ad3aa8d25e2e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:57.133274 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-270cbcee-87d6-4136-a2cf-ad3aa8d25e2e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:57.133895 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-270cbcee-87d6-4136-a2cf-ad3aa8d25e2e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:57.134403 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-270cbcee-87d6-4136-a2cf-ad3aa8d25e2e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:57.135264 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-270cbcee-87d6-4136-a2cf-ad3aa8d25e2e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:57.135808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-270cbcee-87d6-4136-a2cf-ad3aa8d25e2e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:57.137119 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-270cbcee-87d6-4136-a2cf-ad3aa8d25e2e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:57.282172 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-270cbcee-87d6-4136-a2cf-ad3aa8d25e2e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:57.289951 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-270cbcee-87d6-4136-a2cf-ad3aa8d25e2e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.167711 Sep 08 14:00:57.290522 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 96/188] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:57 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:58.332004 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ec0f8da6-02e8-42d1-9370-0412e8dc2860 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:58.332995 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ec0f8da6-02e8-42d1-9370-0412e8dc2860 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:58.341665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec0f8da6-02e8-42d1-9370-0412e8dc2860 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:58.342462 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec0f8da6-02e8-42d1-9370-0412e8dc2860 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:58.343055 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec0f8da6-02e8-42d1-9370-0412e8dc2860 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:58.343816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec0f8da6-02e8-42d1-9370-0412e8dc2860 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:58.344342 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec0f8da6-02e8-42d1-9370-0412e8dc2860 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:58.344827 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec0f8da6-02e8-42d1-9370-0412e8dc2860 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:58.480704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ec0f8da6-02e8-42d1-9370-0412e8dc2860 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:58.491924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ec0f8da6-02e8-42d1-9370-0412e8dc2860 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.172714 Sep 08 14:00:58.492824 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 93/189] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:58 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:58.981649 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b4f47b9b-b1f7-48a9-88de-8875e583effb tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4fa1503-bac9-4597-ba45-a11900dd8a2b"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:58.984216 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b4f47b9b-b1f7-48a9-88de-8875e583effb tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:58.990513 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4f47b9b-b1f7-48a9-88de-8875e583effb tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:58.991043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4f47b9b-b1f7-48a9-88de-8875e583effb tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:58.991474 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4f47b9b-b1f7-48a9-88de-8875e583effb tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:58.992163 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4f47b9b-b1f7-48a9-88de-8875e583effb tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:58.992611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4f47b9b-b1f7-48a9-88de-8875e583effb tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:58.993028 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4f47b9b-b1f7-48a9-88de-8875e583effb tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:59.516872 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-88960261-277e-4574-bbf3-2f8fe7cc6fa1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:59.517580 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-88960261-277e-4574-bbf3-2f8fe7cc6fa1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:59.523701 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88960261-277e-4574-bbf3-2f8fe7cc6fa1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:59.524254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88960261-277e-4574-bbf3-2f8fe7cc6fa1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:59.525014 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88960261-277e-4574-bbf3-2f8fe7cc6fa1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:59.525784 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88960261-277e-4574-bbf3-2f8fe7cc6fa1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:59.526325 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88960261-277e-4574-bbf3-2f8fe7cc6fa1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:59.526749 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88960261-277e-4574-bbf3-2f8fe7cc6fa1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:59.693472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-88960261-277e-4574-bbf3-2f8fe7cc6fa1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:59.712392 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-88960261-277e-4574-bbf3-2f8fe7cc6fa1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1322 microversion: 2.1 time: 0.199502 Sep 08 14:00:59.712990 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 94/190] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:59 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:00.736054 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-eb8b4eec-45c2-434a-bbc8-e39e72208a14 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:00.736724 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-eb8b4eec-45c2-434a-bbc8-e39e72208a14 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:00.742715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb8b4eec-45c2-434a-bbc8-e39e72208a14 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:00.743229 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb8b4eec-45c2-434a-bbc8-e39e72208a14 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:00.743660 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb8b4eec-45c2-434a-bbc8-e39e72208a14 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:00.744357 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb8b4eec-45c2-434a-bbc8-e39e72208a14 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:00.744803 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb8b4eec-45c2-434a-bbc8-e39e72208a14 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:00.745787 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb8b4eec-45c2-434a-bbc8-e39e72208a14 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:00.832914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b4f47b9b-b1f7-48a9-88de-8875e583effb tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "POST /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.855799 Sep 08 14:01:00.837191 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 97/191] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:00:58 2022] POST /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935/os-volume_attachments => generated 194 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:00.928867 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-eb8b4eec-45c2-434a-bbc8-e39e72208a14 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:00.937875 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-eb8b4eec-45c2-434a-bbc8-e39e72208a14 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1515 microversion: 2.1 time: 0.206030 Sep 08 14:01:00.947257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 95/192] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:00 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:00.963725 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6a25177a-43b0-4a3e-8bc5-5999048448a2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:00.966567 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6a25177a-43b0-4a3e-8bc5-5999048448a2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:00.972873 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6a25177a-43b0-4a3e-8bc5-5999048448a2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:00.973366 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6a25177a-43b0-4a3e-8bc5-5999048448a2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:00.973804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6a25177a-43b0-4a3e-8bc5-5999048448a2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:00.974497 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6a25177a-43b0-4a3e-8bc5-5999048448a2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:00.974996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6a25177a-43b0-4a3e-8bc5-5999048448a2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:00.975420 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6a25177a-43b0-4a3e-8bc5-5999048448a2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:01.000357 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-6a25177a-43b0-4a3e-8bc5-5999048448a2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lazy-loading 'flavor' on Instance uuid 669cbb96-aa6a-43b6-b943-3d6ffef440c7 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:01:01.534277 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6a25177a-43b0-4a3e-8bc5-5999048448a2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7/action" status: 200 len: 32 microversion: 2.1 time: 0.575437 Sep 08 14:01:01.534931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 98/193] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:01:00 2022] POST /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7/action => generated 32 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:01:01.545362 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-44bfd46a-3fb4-4e84-a465-5b886c9b3674 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:01.545961 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-44bfd46a-3fb4-4e84-a465-5b886c9b3674 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:01.553154 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44bfd46a-3fb4-4e84-a465-5b886c9b3674 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:01.553676 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44bfd46a-3fb4-4e84-a465-5b886c9b3674 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:01.554209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44bfd46a-3fb4-4e84-a465-5b886c9b3674 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:01.554831 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44bfd46a-3fb4-4e84-a465-5b886c9b3674 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:01.555425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44bfd46a-3fb4-4e84-a465-5b886c9b3674 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:01.555850 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44bfd46a-3fb4-4e84-a465-5b886c9b3674 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:01.712395 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-44bfd46a-3fb4-4e84-a465-5b886c9b3674 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:01.720454 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-44bfd46a-3fb4-4e84-a465-5b886c9b3674 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.179591 Sep 08 14:01:01.721152 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 96/194] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:01 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:02.744921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-77538e0d-8d04-463b-9680-d9ec75c26208 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:02.745806 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-77538e0d-8d04-463b-9680-d9ec75c26208 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:02.753110 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77538e0d-8d04-463b-9680-d9ec75c26208 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:02.753595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77538e0d-8d04-463b-9680-d9ec75c26208 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:02.754033 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77538e0d-8d04-463b-9680-d9ec75c26208 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:02.754725 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77538e0d-8d04-463b-9680-d9ec75c26208 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:02.755250 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77538e0d-8d04-463b-9680-d9ec75c26208 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:02.755681 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77538e0d-8d04-463b-9680-d9ec75c26208 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:02.891955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-77538e0d-8d04-463b-9680-d9ec75c26208 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:02.900009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-77538e0d-8d04-463b-9680-d9ec75c26208 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.159700 Sep 08 14:01:02.900584 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 99/195] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:02 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:03.925414 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-92c2e230-2fb9-4ff7-919b-251beecc2d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:03.926593 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-92c2e230-2fb9-4ff7-919b-251beecc2d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:03.933823 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92c2e230-2fb9-4ff7-919b-251beecc2d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:03.934523 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92c2e230-2fb9-4ff7-919b-251beecc2d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:03.935230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92c2e230-2fb9-4ff7-919b-251beecc2d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:03.936500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92c2e230-2fb9-4ff7-919b-251beecc2d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:03.937229 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92c2e230-2fb9-4ff7-919b-251beecc2d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:03.937830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92c2e230-2fb9-4ff7-919b-251beecc2d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:04.086289 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-92c2e230-2fb9-4ff7-919b-251beecc2d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:04.102813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-92c2e230-2fb9-4ff7-919b-251beecc2d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.180717 Sep 08 14:01:04.104068 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 97/196] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:03 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:05.138135 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ba86c994-c854-42ff-a4ea-adb7a99613bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:05.138790 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ba86c994-c854-42ff-a4ea-adb7a99613bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:05.145156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba86c994-c854-42ff-a4ea-adb7a99613bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:05.155874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba86c994-c854-42ff-a4ea-adb7a99613bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:05.155874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba86c994-c854-42ff-a4ea-adb7a99613bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:05.155874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba86c994-c854-42ff-a4ea-adb7a99613bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:05.155874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba86c994-c854-42ff-a4ea-adb7a99613bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:05.156252 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba86c994-c854-42ff-a4ea-adb7a99613bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:05.300405 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ba86c994-c854-42ff-a4ea-adb7a99613bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:05.309942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ba86c994-c854-42ff-a4ea-adb7a99613bd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.176246 Sep 08 14:01:05.310734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 100/197] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:05 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:06.336755 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-54345205-87ac-410d-9c2c-dc3b8f05b2af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:06.337188 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-54345205-87ac-410d-9c2c-dc3b8f05b2af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:06.348247 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-54345205-87ac-410d-9c2c-dc3b8f05b2af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:06.348777 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-54345205-87ac-410d-9c2c-dc3b8f05b2af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:06.349218 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-54345205-87ac-410d-9c2c-dc3b8f05b2af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:06.349956 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-54345205-87ac-410d-9c2c-dc3b8f05b2af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:06.350418 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-54345205-87ac-410d-9c2c-dc3b8f05b2af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:06.350846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-54345205-87ac-410d-9c2c-dc3b8f05b2af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:06.495160 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-54345205-87ac-410d-9c2c-dc3b8f05b2af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:06.503192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-54345205-87ac-410d-9c2c-dc3b8f05b2af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.172753 Sep 08 14:01:06.503765 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 98/198] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:06 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:07.529831 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d733c477-bc30-4ffb-833c-7f7c105877da tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:07.529831 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d733c477-bc30-4ffb-833c-7f7c105877da tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:07.536442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d733c477-bc30-4ffb-833c-7f7c105877da tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:07.536921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d733c477-bc30-4ffb-833c-7f7c105877da tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:07.537344 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d733c477-bc30-4ffb-833c-7f7c105877da tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:07.538091 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d733c477-bc30-4ffb-833c-7f7c105877da tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:07.538578 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d733c477-bc30-4ffb-833c-7f7c105877da tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:07.539049 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d733c477-bc30-4ffb-833c-7f7c105877da tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:07.694445 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d733c477-bc30-4ffb-833c-7f7c105877da tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:07.703041 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d733c477-bc30-4ffb-833c-7f7c105877da tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.179907 Sep 08 14:01:07.703611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 101/199] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:07 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:08.726563 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-707df1a5-c447-4360-9dc8-9a43c87ba3ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:08.727192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-707df1a5-c447-4360-9dc8-9a43c87ba3ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:08.734596 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-707df1a5-c447-4360-9dc8-9a43c87ba3ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:08.735299 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-707df1a5-c447-4360-9dc8-9a43c87ba3ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:08.735557 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-707df1a5-c447-4360-9dc8-9a43c87ba3ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:08.738003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-707df1a5-c447-4360-9dc8-9a43c87ba3ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:08.738003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-707df1a5-c447-4360-9dc8-9a43c87ba3ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:08.738003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-707df1a5-c447-4360-9dc8-9a43c87ba3ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:08.917765 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-707df1a5-c447-4360-9dc8-9a43c87ba3ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:08.925852 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-707df1a5-c447-4360-9dc8-9a43c87ba3ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.203130 Sep 08 14:01:08.926501 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 99/200] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:08 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:09.951262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-fec54977-f0e9-4ffd-99c0-f17225bec7fe tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:09.952970 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-fec54977-f0e9-4ffd-99c0-f17225bec7fe tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:09.960518 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fec54977-f0e9-4ffd-99c0-f17225bec7fe tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:09.961097 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fec54977-f0e9-4ffd-99c0-f17225bec7fe tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:09.961597 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fec54977-f0e9-4ffd-99c0-f17225bec7fe tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:09.962389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fec54977-f0e9-4ffd-99c0-f17225bec7fe tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:09.962960 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fec54977-f0e9-4ffd-99c0-f17225bec7fe tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:09.964482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fec54977-f0e9-4ffd-99c0-f17225bec7fe tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:10.097403 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-fec54977-f0e9-4ffd-99c0-f17225bec7fe tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:10.106213 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-fec54977-f0e9-4ffd-99c0-f17225bec7fe tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.160012 Sep 08 14:01:10.106908 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 102/201] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:09 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:11.129419 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-198faebd-c57b-4711-8d78-a21718729eb5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:11.130056 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-198faebd-c57b-4711-8d78-a21718729eb5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:11.136145 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-198faebd-c57b-4711-8d78-a21718729eb5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:11.136628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-198faebd-c57b-4711-8d78-a21718729eb5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:11.137071 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-198faebd-c57b-4711-8d78-a21718729eb5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:11.137793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-198faebd-c57b-4711-8d78-a21718729eb5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:11.138246 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-198faebd-c57b-4711-8d78-a21718729eb5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:11.140080 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-198faebd-c57b-4711-8d78-a21718729eb5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:11.285744 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-198faebd-c57b-4711-8d78-a21718729eb5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:11.294180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-198faebd-c57b-4711-8d78-a21718729eb5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.168576 Sep 08 14:01:11.294748 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 100/202] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:11 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:12.318860 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1e030c26-df7e-42b3-8b1a-055192f78fec tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:12.319493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1e030c26-df7e-42b3-8b1a-055192f78fec tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:12.327228 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e030c26-df7e-42b3-8b1a-055192f78fec tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:12.327715 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e030c26-df7e-42b3-8b1a-055192f78fec tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:12.328145 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e030c26-df7e-42b3-8b1a-055192f78fec tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:12.328840 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e030c26-df7e-42b3-8b1a-055192f78fec tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:12.329284 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e030c26-df7e-42b3-8b1a-055192f78fec tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:12.329708 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e030c26-df7e-42b3-8b1a-055192f78fec tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:12.349851 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:12.469546 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1e030c26-df7e-42b3-8b1a-055192f78fec tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:12.476102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1e030c26-df7e-42b3-8b1a-055192f78fec tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.161329 Sep 08 14:01:12.476671 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 103/203] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:12 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:13.498779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8a178ec5-08f9-42bf-a007-4206434dfdaa tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:13.499421 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8a178ec5-08f9-42bf-a007-4206434dfdaa tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:13.505665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a178ec5-08f9-42bf-a007-4206434dfdaa tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:13.506142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a178ec5-08f9-42bf-a007-4206434dfdaa tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:13.506573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a178ec5-08f9-42bf-a007-4206434dfdaa tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:13.507286 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a178ec5-08f9-42bf-a007-4206434dfdaa tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:13.507735 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a178ec5-08f9-42bf-a007-4206434dfdaa tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:13.508154 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a178ec5-08f9-42bf-a007-4206434dfdaa tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:13.643451 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8a178ec5-08f9-42bf-a007-4206434dfdaa tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:13.651762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8a178ec5-08f9-42bf-a007-4206434dfdaa tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.157376 Sep 08 14:01:13.652983 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 101/204] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:13 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:14.675619 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-54ff2a25-1035-4bc2-a5b6-e3587e25deb2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:14.676247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-54ff2a25-1035-4bc2-a5b6-e3587e25deb2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:14.683449 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54ff2a25-1035-4bc2-a5b6-e3587e25deb2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:14.684534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54ff2a25-1035-4bc2-a5b6-e3587e25deb2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:14.684970 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54ff2a25-1035-4bc2-a5b6-e3587e25deb2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:14.685663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54ff2a25-1035-4bc2-a5b6-e3587e25deb2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:14.686144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54ff2a25-1035-4bc2-a5b6-e3587e25deb2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:14.686596 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54ff2a25-1035-4bc2-a5b6-e3587e25deb2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:14.817809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-54ff2a25-1035-4bc2-a5b6-e3587e25deb2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:14.825462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-54ff2a25-1035-4bc2-a5b6-e3587e25deb2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.153626 Sep 08 14:01:14.826005 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 104/205] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:14 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:15.849435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6940d72f-c065-4989-bb4d-00d0a2d7e3e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:15.850073 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6940d72f-c065-4989-bb4d-00d0a2d7e3e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:15.856199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6940d72f-c065-4989-bb4d-00d0a2d7e3e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:15.857353 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6940d72f-c065-4989-bb4d-00d0a2d7e3e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:15.857814 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6940d72f-c065-4989-bb4d-00d0a2d7e3e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:15.858608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6940d72f-c065-4989-bb4d-00d0a2d7e3e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:15.859135 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6940d72f-c065-4989-bb4d-00d0a2d7e3e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:15.859580 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6940d72f-c065-4989-bb4d-00d0a2d7e3e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:16.019605 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6940d72f-c065-4989-bb4d-00d0a2d7e3e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:16.027733 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6940d72f-c065-4989-bb4d-00d0a2d7e3e3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.182087 Sep 08 14:01:16.028231 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 102/206] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:15 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:16.491465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-cae039b8-66d1-4b8a-ba40-a63f0b01809e tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:16.491465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-cae039b8-66d1-4b8a-ba40-a63f0b01809e tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:16.499262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cae039b8-66d1-4b8a-ba40-a63f0b01809e tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:16.499775 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cae039b8-66d1-4b8a-ba40-a63f0b01809e tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:16.500187 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cae039b8-66d1-4b8a-ba40-a63f0b01809e tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:16.501201 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cae039b8-66d1-4b8a-ba40-a63f0b01809e tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:16.501665 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cae039b8-66d1-4b8a-ba40-a63f0b01809e tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:16.502085 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cae039b8-66d1-4b8a-ba40-a63f0b01809e tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:16.530988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-cae039b8-66d1-4b8a-ba40-a63f0b01809e tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Going to try to terminate instance {{(pid=133059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:01:16.884724 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-cae039b8-66d1-4b8a-ba40-a63f0b01809e tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "DELETE /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 204 len: 0 microversion: 2.1 time: 0.397612 Sep 08 14:01:16.885311 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 105/207] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:01:16 2022] DELETE /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:01:16.894026 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-aed32d8a-8586-44d9-bdf8-35292af179ca tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:16.894627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-aed32d8a-8586-44d9-bdf8-35292af179ca tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:16.901350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aed32d8a-8586-44d9-bdf8-35292af179ca tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:16.901841 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aed32d8a-8586-44d9-bdf8-35292af179ca tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:16.902278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aed32d8a-8586-44d9-bdf8-35292af179ca tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:16.903001 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aed32d8a-8586-44d9-bdf8-35292af179ca tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:16.904126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aed32d8a-8586-44d9-bdf8-35292af179ca tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:16.904611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aed32d8a-8586-44d9-bdf8-35292af179ca tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:17.055853 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f9a4df7f-396e-4cef-a049-8b05f7dde2cd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:17.056978 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f9a4df7f-396e-4cef-a049-8b05f7dde2cd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:17.066738 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9a4df7f-396e-4cef-a049-8b05f7dde2cd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:17.067395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9a4df7f-396e-4cef-a049-8b05f7dde2cd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:17.068021 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9a4df7f-396e-4cef-a049-8b05f7dde2cd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:17.068726 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9a4df7f-396e-4cef-a049-8b05f7dde2cd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:17.069184 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9a4df7f-396e-4cef-a049-8b05f7dde2cd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:17.069637 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9a4df7f-396e-4cef-a049-8b05f7dde2cd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:17.135881 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-aed32d8a-8586-44d9-bdf8-35292af179ca tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:17.148113 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-aed32d8a-8586-44d9-bdf8-35292af179ca tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1554 microversion: 2.1 time: 0.257914 Sep 08 14:01:17.148721 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 103/208] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:16 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1554 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:17.219880 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f9a4df7f-396e-4cef-a049-8b05f7dde2cd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:17.229280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f9a4df7f-396e-4cef-a049-8b05f7dde2cd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.180907 Sep 08 14:01:17.230440 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 106/209] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:17 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:18.174785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ad8e8528-3d71-40d0-893f-10112e801855 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:18.176485 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ad8e8528-3d71-40d0-893f-10112e801855 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:18.186191 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad8e8528-3d71-40d0-893f-10112e801855 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:18.186697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad8e8528-3d71-40d0-893f-10112e801855 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:18.187444 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad8e8528-3d71-40d0-893f-10112e801855 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:18.196237 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad8e8528-3d71-40d0-893f-10112e801855 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:18.196237 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad8e8528-3d71-40d0-893f-10112e801855 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:18.196237 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad8e8528-3d71-40d0-893f-10112e801855 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:18.255757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-23c96d0d-33f9-4672-b2fb-7e59513c3963 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:18.259354 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-23c96d0d-33f9-4672-b2fb-7e59513c3963 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:18.267159 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23c96d0d-33f9-4672-b2fb-7e59513c3963 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:18.267991 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23c96d0d-33f9-4672-b2fb-7e59513c3963 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:18.269193 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23c96d0d-33f9-4672-b2fb-7e59513c3963 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:18.270416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23c96d0d-33f9-4672-b2fb-7e59513c3963 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:18.271369 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23c96d0d-33f9-4672-b2fb-7e59513c3963 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:18.272008 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23c96d0d-33f9-4672-b2fb-7e59513c3963 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:18.349980 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ad8e8528-3d71-40d0-893f-10112e801855 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:18.362305 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ad8e8528-3d71-40d0-893f-10112e801855 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1554 microversion: 2.1 time: 0.191990 Sep 08 14:01:18.363194 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 104/210] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:18 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:18.449846 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-23c96d0d-33f9-4672-b2fb-7e59513c3963 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:18.458005 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-23c96d0d-33f9-4672-b2fb-7e59513c3963 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.208092 Sep 08 14:01:18.458707 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 107/211] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:18 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:19.389200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-89f1630a-fcc3-47e3-82fd-adf00293e3bd tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:19.389815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-89f1630a-fcc3-47e3-82fd-adf00293e3bd tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:19.391973 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=60 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:19.398286 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89f1630a-fcc3-47e3-82fd-adf00293e3bd tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:19.398637 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89f1630a-fcc3-47e3-82fd-adf00293e3bd tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:19.399926 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89f1630a-fcc3-47e3-82fd-adf00293e3bd tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:19.400246 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89f1630a-fcc3-47e3-82fd-adf00293e3bd tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:19.400775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89f1630a-fcc3-47e3-82fd-adf00293e3bd tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:19.401202 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89f1630a-fcc3-47e3-82fd-adf00293e3bd tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:19.486101 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ee38d7fa-16cc-4238-bde5-58186c05b659 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:19.487366 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ee38d7fa-16cc-4238-bde5-58186c05b659 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:19.495225 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee38d7fa-16cc-4238-bde5-58186c05b659 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:19.495911 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee38d7fa-16cc-4238-bde5-58186c05b659 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:19.496352 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee38d7fa-16cc-4238-bde5-58186c05b659 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:19.497064 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee38d7fa-16cc-4238-bde5-58186c05b659 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:19.498116 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee38d7fa-16cc-4238-bde5-58186c05b659 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:19.498623 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee38d7fa-16cc-4238-bde5-58186c05b659 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:19.582924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-89f1630a-fcc3-47e3-82fd-adf00293e3bd tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:19.596272 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-89f1630a-fcc3-47e3-82fd-adf00293e3bd tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1554 microversion: 2.1 time: 0.212343 Sep 08 14:01:19.597203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 105/212] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:19 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:19.694388 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ee38d7fa-16cc-4238-bde5-58186c05b659 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:19.703503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ee38d7fa-16cc-4238-bde5-58186c05b659 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.221478 Sep 08 14:01:19.704335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 108/213] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:19 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:20.588657 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-2ed69518-a5ed-47f6-9f32-2142a5cbe2b4 req-fcceae6d-fce9-4fb0-bf5f-232d592f4717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf2e3658-e4d5-4914-8e30-b3e710cdb935", "name": "network-vif-deleted", "tag": "ea3bc6ce-56d5-4aa4-8ae0-4ec904dc93e2"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:20.603752 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2ed69518-a5ed-47f6-9f32-2142a5cbe2b4 req-fcceae6d-fce9-4fb0-bf5f-232d592f4717 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:20.604863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2ed69518-a5ed-47f6-9f32-2142a5cbe2b4 req-fcceae6d-fce9-4fb0-bf5f-232d592f4717 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:20.605403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2ed69518-a5ed-47f6-9f32-2142a5cbe2b4 req-fcceae6d-fce9-4fb0-bf5f-232d592f4717 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:20.628194 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-351e1054-add0-4a7f-ab2f-aee909831681 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:20.629369 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-351e1054-add0-4a7f-ab2f-aee909831681 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:20.639698 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-351e1054-add0-4a7f-ab2f-aee909831681 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:20.639698 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-351e1054-add0-4a7f-ab2f-aee909831681 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:20.639698 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-351e1054-add0-4a7f-ab2f-aee909831681 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:20.640318 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-351e1054-add0-4a7f-ab2f-aee909831681 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:20.641568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-351e1054-add0-4a7f-ab2f-aee909831681 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:20.642017 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-351e1054-add0-4a7f-ab2f-aee909831681 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:20.644499 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-2ed69518-a5ed-47f6-9f32-2142a5cbe2b4 req-fcceae6d-fce9-4fb0-bf5f-232d592f4717 service nova] Creating event network-vif-deleted:ea3bc6ce-56d5-4aa4-8ae0-4ec904dc93e2 for instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 on hv-cinder-84773 Sep 08 14:01:20.653044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-2ed69518-a5ed-47f6-9f32-2142a5cbe2b4 req-fcceae6d-fce9-4fb0-bf5f-232d592f4717 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080287 Sep 08 14:01:20.654873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 106/214] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:20.727729 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8f483ce1-e85d-425f-8972-7cafb5b34b77 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:20.728498 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8f483ce1-e85d-425f-8972-7cafb5b34b77 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:20.735446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f483ce1-e85d-425f-8972-7cafb5b34b77 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:20.735938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f483ce1-e85d-425f-8972-7cafb5b34b77 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:20.736367 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f483ce1-e85d-425f-8972-7cafb5b34b77 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:20.737057 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f483ce1-e85d-425f-8972-7cafb5b34b77 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:20.737508 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f483ce1-e85d-425f-8972-7cafb5b34b77 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:20.737799 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-351e1054-add0-4a7f-ab2f-aee909831681 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:20.737908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f483ce1-e85d-425f-8972-7cafb5b34b77 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:20.748289 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-351e1054-add0-4a7f-ab2f-aee909831681 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1512 microversion: 2.1 time: 0.126342 Sep 08 14:01:20.749341 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 109/215] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:20 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1512 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:20.920293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8f483ce1-e85d-425f-8972-7cafb5b34b77 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:20.931351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8f483ce1-e85d-425f-8972-7cafb5b34b77 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.207771 Sep 08 14:01:20.947479 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 107/216] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:20 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:21.776709 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-157efbb1-a312-440d-a2e1-e88529769290 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:21.777328 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-157efbb1-a312-440d-a2e1-e88529769290 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:21.784057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-157efbb1-a312-440d-a2e1-e88529769290 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:21.785867 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-157efbb1-a312-440d-a2e1-e88529769290 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:21.786323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-157efbb1-a312-440d-a2e1-e88529769290 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:21.790838 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-157efbb1-a312-440d-a2e1-e88529769290 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:21.790838 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-157efbb1-a312-440d-a2e1-e88529769290 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:21.790838 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-157efbb1-a312-440d-a2e1-e88529769290 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:21.866996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-157efbb1-a312-440d-a2e1-e88529769290 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:21.876165 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-157efbb1-a312-440d-a2e1-e88529769290 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1346 microversion: 2.1 time: 0.103886 Sep 08 14:01:21.876853 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 110/217] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:21 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:21.956924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-da4d51af-1a6b-40aa-96c3-d0b27b77da30 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:21.957655 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-da4d51af-1a6b-40aa-96c3-d0b27b77da30 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:21.964563 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-da4d51af-1a6b-40aa-96c3-d0b27b77da30 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:21.965327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-da4d51af-1a6b-40aa-96c3-d0b27b77da30 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:21.965757 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-da4d51af-1a6b-40aa-96c3-d0b27b77da30 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:21.966702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-da4d51af-1a6b-40aa-96c3-d0b27b77da30 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:21.967714 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-da4d51af-1a6b-40aa-96c3-d0b27b77da30 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:21.968500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-da4d51af-1a6b-40aa-96c3-d0b27b77da30 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:22.137315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-da4d51af-1a6b-40aa-96c3-d0b27b77da30 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:22.147211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-da4d51af-1a6b-40aa-96c3-d0b27b77da30 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.194084 Sep 08 14:01:22.156350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 108/218] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:21 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:22.900817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-43c7fbbd-df73-44a6-bc04-3266b0f933c8 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:22.901435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-43c7fbbd-df73-44a6-bc04-3266b0f933c8 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:22.908507 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43c7fbbd-df73-44a6-bc04-3266b0f933c8 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:22.909049 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43c7fbbd-df73-44a6-bc04-3266b0f933c8 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:22.909849 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43c7fbbd-df73-44a6-bc04-3266b0f933c8 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:22.910779 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43c7fbbd-df73-44a6-bc04-3266b0f933c8 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:22.911343 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43c7fbbd-df73-44a6-bc04-3266b0f933c8 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:22.911854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43c7fbbd-df73-44a6-bc04-3266b0f933c8 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:22.990158 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-43c7fbbd-df73-44a6-bc04-3266b0f933c8 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:23.004854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-43c7fbbd-df73-44a6-bc04-3266b0f933c8 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1346 microversion: 2.1 time: 0.108669 Sep 08 14:01:23.005422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 111/219] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:22 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:23.172939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a2a8d54c-0153-4fbd-9b80-c71b8b8920a3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:23.173566 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a2a8d54c-0153-4fbd-9b80-c71b8b8920a3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:23.182416 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2a8d54c-0153-4fbd-9b80-c71b8b8920a3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:23.183195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2a8d54c-0153-4fbd-9b80-c71b8b8920a3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:23.183679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2a8d54c-0153-4fbd-9b80-c71b8b8920a3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:23.184642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2a8d54c-0153-4fbd-9b80-c71b8b8920a3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:23.185445 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2a8d54c-0153-4fbd-9b80-c71b8b8920a3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:23.186147 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2a8d54c-0153-4fbd-9b80-c71b8b8920a3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:23.383958 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a2a8d54c-0153-4fbd-9b80-c71b8b8920a3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:23.392718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a2a8d54c-0153-4fbd-9b80-c71b8b8920a3 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.224383 Sep 08 14:01:23.393469 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 109/220] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:23 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:24.029197 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e3c8e0f4-6e6d-4a66-866a-72b205902711 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:24.029810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e3c8e0f4-6e6d-4a66-866a-72b205902711 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:24.032323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:24.036999 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3c8e0f4-6e6d-4a66-866a-72b205902711 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:24.037478 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3c8e0f4-6e6d-4a66-866a-72b205902711 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:24.041274 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3c8e0f4-6e6d-4a66-866a-72b205902711 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:24.041274 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3c8e0f4-6e6d-4a66-866a-72b205902711 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:24.041274 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3c8e0f4-6e6d-4a66-866a-72b205902711 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:24.041274 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3c8e0f4-6e6d-4a66-866a-72b205902711 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:24.111927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e3c8e0f4-6e6d-4a66-866a-72b205902711 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:24.121705 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e3c8e0f4-6e6d-4a66-866a-72b205902711 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1346 microversion: 2.1 time: 0.096278 Sep 08 14:01:24.123234 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 112/221] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:24 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:24.422481 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a975a04d-01fc-4da9-8078-6cfc579d3c73 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:24.423353 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a975a04d-01fc-4da9-8078-6cfc579d3c73 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:24.433960 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a975a04d-01fc-4da9-8078-6cfc579d3c73 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:24.435392 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a975a04d-01fc-4da9-8078-6cfc579d3c73 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:24.436160 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a975a04d-01fc-4da9-8078-6cfc579d3c73 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:24.437404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a975a04d-01fc-4da9-8078-6cfc579d3c73 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:24.438182 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a975a04d-01fc-4da9-8078-6cfc579d3c73 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:24.438949 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a975a04d-01fc-4da9-8078-6cfc579d3c73 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:24.443929 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:24.639181 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a975a04d-01fc-4da9-8078-6cfc579d3c73 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:24.652009 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a975a04d-01fc-4da9-8078-6cfc579d3c73 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.237757 Sep 08 14:01:24.652816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 110/222] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:24 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:25.145728 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:25.146381 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:25.154797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:25.155358 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:25.155783 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:25.156487 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:25.156935 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:25.157344 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:25.197292 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:25.197517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:25.198017 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:25.198459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lazy-loading 'fault' on Instance uuid bf2e3658-e4d5-4914-8e30-b3e710cdb935 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:01:25.247823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5771e9d0c5c94306b3ec571916acdcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f768b4d35c1b4713b58e3d582adcc93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:25.260541 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a18809d1-a175-453b-979e-35f187e03f35 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 200 len: 1351 microversion: 2.1 time: 0.118675 Sep 08 14:01:25.261332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 113/223] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:25 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 1351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:25.679349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c47d98da-da52-4f6d-8faa-92e6ad5652bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:25.679952 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c47d98da-da52-4f6d-8faa-92e6ad5652bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:25.689908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c47d98da-da52-4f6d-8faa-92e6ad5652bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:25.690395 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c47d98da-da52-4f6d-8faa-92e6ad5652bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:25.690821 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c47d98da-da52-4f6d-8faa-92e6ad5652bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:25.691631 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c47d98da-da52-4f6d-8faa-92e6ad5652bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:25.692078 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c47d98da-da52-4f6d-8faa-92e6ad5652bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:25.692495 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c47d98da-da52-4f6d-8faa-92e6ad5652bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:25.840237 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c47d98da-da52-4f6d-8faa-92e6ad5652bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:25.851603 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c47d98da-da52-4f6d-8faa-92e6ad5652bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.176315 Sep 08 14:01:25.863207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 111/224] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:25 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:26.291256 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:26.292030 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:26.298931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:26.299409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:26.299840 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:26.300536 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:26.301056 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:26.301476 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:26.316145 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] HTTP exception thrown: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Request method failure captured: Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 HTTP/1.1 Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVgnclPyF7Y9mPTmtDssnkSEwaHUTybV1GY7YYjwdtXzFtZIJ3psVCgwbTRnufBZcGJ1RkxT-7AMPEIAghwqn6FtauyyJmlIVUe_Bk26U9vMivbOnYrI-fE_emTm2aov8ShljyiHttKB6t4juz9mdjNkI2IiBMct-nYdEHWFcCh-Yo Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: f768b4d35c1b4713b58e3d582adcc93f Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:01:26.321094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_f768b4d35c1b4713b58e3d582adcc93f", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: f768b4d35c1b4713b58e3d582adcc93f Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-DeleteServersTestJSON-12215930-project Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 5771e9d0c5c94306b3ec571916acdcaa Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-DeleteServersTestJSON-12215930-project Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:26.323815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': 'bf2e3658-e4d5-4914-8e30-b3e710cdb935'} Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:01:26.325539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:26.328331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:01:26.330912 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Returning 404 to user: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:01:26.330912 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3aee4af7-7401-4d7d-a360-bb49bb105e81 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 404 len: 111 microversion: 2.1 time: 0.035405 Sep 08 14:01:26.330912 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 114/225] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:26 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:01:26.459378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:26.461587 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:26.468368 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:26.468850 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:26.469283 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:26.469982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:26.470427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:26.470845 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:26.486237 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] HTTP exception thrown: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Request method failure captured: Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935/os-volume_attachments HTTP/1.1 Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVgnclPyF7Y9mPTmtDssnkSEwaHUTybV1GY7YYjwdtXzFtZIJ3psVCgwbTRnufBZcGJ1RkxT-7AMPEIAghwqn6FtauyyJmlIVUe_Bk26U9vMivbOnYrI-fE_emTm2aov8ShljyiHttKB6t4juz9mdjNkI2IiBMct-nYdEHWFcCh-Yo Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: f768b4d35c1b4713b58e3d582adcc93f Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:01:26.490868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_f768b4d35c1b4713b58e3d582adcc93f", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: f768b4d35c1b4713b58e3d582adcc93f Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-DeleteServersTestJSON-12215930-project Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 5771e9d0c5c94306b3ec571916acdcaa Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-DeleteServersTestJSON-12215930-project Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:26.499021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'server_id': 'bf2e3658-e4d5-4914-8e30-b3e710cdb935'} Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:01:26.502413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:26.505180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:01:26.507276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Returning 404 to user: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:01:26.507276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-aa89dc3f-6887-4825-9c26-bcbdaa2936da tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036665 Sep 08 14:01:26.507276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 112/226] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:01:26 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:01:26.880105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-fb68b2aa-babf-49d6-95f6-20d6af6f9795 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:26.880694 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-fb68b2aa-babf-49d6-95f6-20d6af6f9795 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:26.888760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fb68b2aa-babf-49d6-95f6-20d6af6f9795 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:26.889263 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fb68b2aa-babf-49d6-95f6-20d6af6f9795 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:26.889703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fb68b2aa-babf-49d6-95f6-20d6af6f9795 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:26.890401 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fb68b2aa-babf-49d6-95f6-20d6af6f9795 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:26.890854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fb68b2aa-babf-49d6-95f6-20d6af6f9795 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:26.891306 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fb68b2aa-babf-49d6-95f6-20d6af6f9795 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:27.022575 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-fb68b2aa-babf-49d6-95f6-20d6af6f9795 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:27.030784 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-fb68b2aa-babf-49d6-95f6-20d6af6f9795 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.155028 Sep 08 14:01:27.031385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 115/227] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:26 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:28.054004 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4f2ac2b6-403f-4957-a8c3-a4cf4505452d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:28.055011 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4f2ac2b6-403f-4957-a8c3-a4cf4505452d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:28.061271 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4f2ac2b6-403f-4957-a8c3-a4cf4505452d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:28.061757 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4f2ac2b6-403f-4957-a8c3-a4cf4505452d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:28.062193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4f2ac2b6-403f-4957-a8c3-a4cf4505452d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:28.062906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4f2ac2b6-403f-4957-a8c3-a4cf4505452d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:28.063439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4f2ac2b6-403f-4957-a8c3-a4cf4505452d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:28.063861 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4f2ac2b6-403f-4957-a8c3-a4cf4505452d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:28.196211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4f2ac2b6-403f-4957-a8c3-a4cf4505452d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:28.205091 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4f2ac2b6-403f-4957-a8c3-a4cf4505452d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.155271 Sep 08 14:01:28.205656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 113/228] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:28 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:29.227378 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0ceb6c3c-4846-41d1-815b-5b6534b6c75e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:29.227985 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0ceb6c3c-4846-41d1-815b-5b6534b6c75e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:29.234821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ceb6c3c-4846-41d1-815b-5b6534b6c75e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:29.235330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ceb6c3c-4846-41d1-815b-5b6534b6c75e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:29.237123 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ceb6c3c-4846-41d1-815b-5b6534b6c75e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:29.237123 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ceb6c3c-4846-41d1-815b-5b6534b6c75e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:29.237123 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ceb6c3c-4846-41d1-815b-5b6534b6c75e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:29.237440 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ceb6c3c-4846-41d1-815b-5b6534b6c75e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:29.373485 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0ceb6c3c-4846-41d1-815b-5b6534b6c75e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:29.382521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0ceb6c3c-4846-41d1-815b-5b6534b6c75e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.159047 Sep 08 14:01:29.386282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 116/229] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:29 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:30.407731 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-66f9c1cd-8d28-44cb-8946-add65e966bbf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:30.408308 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-66f9c1cd-8d28-44cb-8946-add65e966bbf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:30.414435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66f9c1cd-8d28-44cb-8946-add65e966bbf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:30.420428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66f9c1cd-8d28-44cb-8946-add65e966bbf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:30.420428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66f9c1cd-8d28-44cb-8946-add65e966bbf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:30.420428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66f9c1cd-8d28-44cb-8946-add65e966bbf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:30.420428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66f9c1cd-8d28-44cb-8946-add65e966bbf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:30.420800 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66f9c1cd-8d28-44cb-8946-add65e966bbf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:30.556744 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-66f9c1cd-8d28-44cb-8946-add65e966bbf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:30.565205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-66f9c1cd-8d28-44cb-8946-add65e966bbf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.162124 Sep 08 14:01:30.565768 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 114/230] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:30 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:31.019485 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:31.020002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:31.029792 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:31.029792 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:31.029792 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:31.029792 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:31.030167 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:31.030167 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:31.043874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] HTTP exception thrown: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Request method failure captured: Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: DELETE /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 HTTP/1.1 Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVgnclPyF7Y9mPTmtDssnkSEwaHUTybV1GY7YYjwdtXzFtZIJ3psVCgwbTRnufBZcGJ1RkxT-7AMPEIAghwqn6FtauyyJmlIVUe_Bk26U9vMivbOnYrI-fE_emTm2aov8ShljyiHttKB6t4juz9mdjNkI2IiBMct-nYdEHWFcCh-Yo Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: f768b4d35c1b4713b58e3d582adcc93f Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:01:31.045810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_f768b4d35c1b4713b58e3d582adcc93f", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: f768b4d35c1b4713b58e3d582adcc93f Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-DeleteServersTestJSON-12215930-project Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 5771e9d0c5c94306b3ec571916acdcaa Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-DeleteServersTestJSON-12215930-project Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:31.047751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': 'bf2e3658-e4d5-4914-8e30-b3e710cdb935'} Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:01:31.048394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:31.049819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:01:31.051442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Returning 404 to user: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:01:31.051442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-641defae-979b-4eb9-a79c-f613cac9d727 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "DELETE /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 404 len: 111 microversion: 2.1 time: 0.033117 Sep 08 14:01:31.051442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 117/231] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:01:31 2022] DELETE /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:01:31.056957 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:31.075795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] [instance: bf2e3658-e4d5-4914-8e30-b3e710cdb935] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:31.075795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:31.075795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:31.075795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:31.076508 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:31.076508 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:31.076508 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:31.085476 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] HTTP exception thrown: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Request method failure captured: Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 HTTP/1.1 Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVgnclPyF7Y9mPTmtDssnkSEwaHUTybV1GY7YYjwdtXzFtZIJ3psVCgwbTRnufBZcGJ1RkxT-7AMPEIAghwqn6FtauyyJmlIVUe_Bk26U9vMivbOnYrI-fE_emTm2aov8ShljyiHttKB6t4juz9mdjNkI2IiBMct-nYdEHWFcCh-Yo Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: f768b4d35c1b4713b58e3d582adcc93f Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:01:31.087642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_f768b4d35c1b4713b58e3d582adcc93f", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f768b4d35c1b4713b58e3d582adcc93f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: f768b4d35c1b4713b58e3d582adcc93f Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-DeleteServersTestJSON-12215930 Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-DeleteServersTestJSON-12215930-project Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 5771e9d0c5c94306b3ec571916acdcaa Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-DeleteServersTestJSON-12215930-project Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:31.089106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'bf2e3658-e4d5-4914-8e30-b3e710cdb935'} Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:01:31.089840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. Sep 08 14:01:31.090999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:01:31.092038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] Returning 404 to user: Instance bf2e3658-e4d5-4914-8e30-b3e710cdb935 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:01:31.092038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7dd460dc-0715-445d-a3ee-8785737d25c1 tempest-DeleteServersTestJSON-12215930 tempest-DeleteServersTestJSON-12215930-project] 10.222.0.91 "GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935" status: 404 len: 111 microversion: 2.1 time: 0.036118 Sep 08 14:01:31.092038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 115/232] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:31 2022] GET /compute/v2.1/servers/bf2e3658-e4d5-4914-8e30-b3e710cdb935 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:01:31.589036 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-94c1f4dc-80fa-4511-a932-78b52597ec2c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:31.589646 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-94c1f4dc-80fa-4511-a932-78b52597ec2c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:31.595514 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94c1f4dc-80fa-4511-a932-78b52597ec2c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:31.596003 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94c1f4dc-80fa-4511-a932-78b52597ec2c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:31.596437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94c1f4dc-80fa-4511-a932-78b52597ec2c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:31.597129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94c1f4dc-80fa-4511-a932-78b52597ec2c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:31.597581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94c1f4dc-80fa-4511-a932-78b52597ec2c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:31.598036 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94c1f4dc-80fa-4511-a932-78b52597ec2c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:31.741553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-94c1f4dc-80fa-4511-a932-78b52597ec2c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:31.749917 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-94c1f4dc-80fa-4511-a932-78b52597ec2c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.164666 Sep 08 14:01:31.750765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 118/233] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:31 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:32.774318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-687c59c3-5d0a-4aa6-a529-12454171e504 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:32.775209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-687c59c3-5d0a-4aa6-a529-12454171e504 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:32.786224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-687c59c3-5d0a-4aa6-a529-12454171e504 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:32.786224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-687c59c3-5d0a-4aa6-a529-12454171e504 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:32.786224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-687c59c3-5d0a-4aa6-a529-12454171e504 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:32.786224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-687c59c3-5d0a-4aa6-a529-12454171e504 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:32.786627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-687c59c3-5d0a-4aa6-a529-12454171e504 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:32.786627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-687c59c3-5d0a-4aa6-a529-12454171e504 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:33.028905 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-687c59c3-5d0a-4aa6-a529-12454171e504 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:33.037554 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-687c59c3-5d0a-4aa6-a529-12454171e504 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.267177 Sep 08 14:01:33.038529 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 116/234] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:32 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:34.069038 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-07f82a67-44ef-4d24-b5c3-d1c160468e1f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:34.071863 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-07f82a67-44ef-4d24-b5c3-d1c160468e1f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:34.082686 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-07f82a67-44ef-4d24-b5c3-d1c160468e1f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:34.084808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-07f82a67-44ef-4d24-b5c3-d1c160468e1f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:34.087955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-07f82a67-44ef-4d24-b5c3-d1c160468e1f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:34.090607 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-07f82a67-44ef-4d24-b5c3-d1c160468e1f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:34.092034 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-07f82a67-44ef-4d24-b5c3-d1c160468e1f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:34.100316 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-07f82a67-44ef-4d24-b5c3-d1c160468e1f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:34.119298 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:34.323389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-07f82a67-44ef-4d24-b5c3-d1c160468e1f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:34.336793 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-07f82a67-44ef-4d24-b5c3-d1c160468e1f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.271936 Sep 08 14:01:34.337445 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 119/235] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:34 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:35.367494 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4ca2d94b-ab45-4f8b-8a5e-ae970d3a6c4b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:35.368165 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4ca2d94b-ab45-4f8b-8a5e-ae970d3a6c4b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:35.387606 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ca2d94b-ab45-4f8b-8a5e-ae970d3a6c4b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:35.388105 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ca2d94b-ab45-4f8b-8a5e-ae970d3a6c4b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:35.388538 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ca2d94b-ab45-4f8b-8a5e-ae970d3a6c4b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:35.389238 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ca2d94b-ab45-4f8b-8a5e-ae970d3a6c4b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:35.389849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ca2d94b-ab45-4f8b-8a5e-ae970d3a6c4b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:35.390417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4ca2d94b-ab45-4f8b-8a5e-ae970d3a6c4b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:35.711930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4ca2d94b-ab45-4f8b-8a5e-ae970d3a6c4b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:35.723330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4ca2d94b-ab45-4f8b-8a5e-ae970d3a6c4b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.364219 Sep 08 14:01:35.725228 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 117/236] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:35 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:36.751550 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d33b9cac-a076-4129-b35f-095ce50c9322 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:36.752736 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d33b9cac-a076-4129-b35f-095ce50c9322 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:36.774033 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d33b9cac-a076-4129-b35f-095ce50c9322 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:36.775231 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d33b9cac-a076-4129-b35f-095ce50c9322 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:36.776505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d33b9cac-a076-4129-b35f-095ce50c9322 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:36.777611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d33b9cac-a076-4129-b35f-095ce50c9322 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:36.778232 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d33b9cac-a076-4129-b35f-095ce50c9322 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:36.779100 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d33b9cac-a076-4129-b35f-095ce50c9322 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:36.949043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d33b9cac-a076-4129-b35f-095ce50c9322 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:36.956690 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d33b9cac-a076-4129-b35f-095ce50c9322 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.211924 Sep 08 14:01:36.957258 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 120/237] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:36 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:37.982707 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d5d1a954-f88b-44e9-b5d0-acca68f9fe71 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:37.983348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d5d1a954-f88b-44e9-b5d0-acca68f9fe71 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:37.989716 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5d1a954-f88b-44e9-b5d0-acca68f9fe71 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:37.990205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5d1a954-f88b-44e9-b5d0-acca68f9fe71 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:37.991048 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5d1a954-f88b-44e9-b5d0-acca68f9fe71 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:37.991954 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5d1a954-f88b-44e9-b5d0-acca68f9fe71 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:37.992574 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5d1a954-f88b-44e9-b5d0-acca68f9fe71 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:37.993153 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5d1a954-f88b-44e9-b5d0-acca68f9fe71 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:38.134206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d5d1a954-f88b-44e9-b5d0-acca68f9fe71 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:38.142336 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d5d1a954-f88b-44e9-b5d0-acca68f9fe71 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.166458 Sep 08 14:01:38.142931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 118/238] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:37 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:39.169462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-424fd647-e7bc-4571-b07c-be8d80f3cffd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:39.170073 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-424fd647-e7bc-4571-b07c-be8d80f3cffd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:39.177450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-424fd647-e7bc-4571-b07c-be8d80f3cffd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:39.178401 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-424fd647-e7bc-4571-b07c-be8d80f3cffd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:39.179155 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-424fd647-e7bc-4571-b07c-be8d80f3cffd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:39.180200 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-424fd647-e7bc-4571-b07c-be8d80f3cffd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:39.180980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-424fd647-e7bc-4571-b07c-be8d80f3cffd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:39.181618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-424fd647-e7bc-4571-b07c-be8d80f3cffd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:39.403291 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-424fd647-e7bc-4571-b07c-be8d80f3cffd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:39.412123 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-424fd647-e7bc-4571-b07c-be8d80f3cffd tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.246363 Sep 08 14:01:39.413415 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 121/239] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:39 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:40.442588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c914ec96-c21c-4c33-b189-09ae0f92a402 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:40.442588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c914ec96-c21c-4c33-b189-09ae0f92a402 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:40.452609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c914ec96-c21c-4c33-b189-09ae0f92a402 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:40.453472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c914ec96-c21c-4c33-b189-09ae0f92a402 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:40.453971 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c914ec96-c21c-4c33-b189-09ae0f92a402 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:40.454780 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c914ec96-c21c-4c33-b189-09ae0f92a402 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:40.455277 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c914ec96-c21c-4c33-b189-09ae0f92a402 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:40.455989 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c914ec96-c21c-4c33-b189-09ae0f92a402 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:40.924479 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c914ec96-c21c-4c33-b189-09ae0f92a402 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:40.932331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c914ec96-c21c-4c33-b189-09ae0f92a402 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.500454 Sep 08 14:01:40.932886 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 119/240] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:40 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:41.956416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f0c75caa-780c-46c6-a93c-7890faa94a74 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:41.957016 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f0c75caa-780c-46c6-a93c-7890faa94a74 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:41.963767 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0c75caa-780c-46c6-a93c-7890faa94a74 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:41.966310 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0c75caa-780c-46c6-a93c-7890faa94a74 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:41.966310 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0c75caa-780c-46c6-a93c-7890faa94a74 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:41.966310 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0c75caa-780c-46c6-a93c-7890faa94a74 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:41.966310 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0c75caa-780c-46c6-a93c-7890faa94a74 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:41.966794 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f0c75caa-780c-46c6-a93c-7890faa94a74 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:42.266154 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f0c75caa-780c-46c6-a93c-7890faa94a74 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:42.275240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f0c75caa-780c-46c6-a93c-7890faa94a74 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.322941 Sep 08 14:01:42.275756 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 122/241] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:41 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:42.592008 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-807868788", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:42.690202 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] validate_networks() for None {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:01:43.169547 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:01:43.170266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:01:43.170806 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:01:43.171422 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:01:43.171832 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:01:43.183437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:43.183928 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:43.184543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:43.185293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:43.185751 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:43.186177 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:43.205496 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Getting quotas for project 2f63c1ffd86d4bd1aa5989c9bb6d850f. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:01:43.210424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Getting quotas for user bfb363a951f149438ddcd4ab8b819429 and project 2f63c1ffd86d4bd1aa5989c9bb6d850f. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:01:43.224223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:01:43.227120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:01:43.298804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-50ec40b9-0646-42b9-892f-e623dc9e0f91 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:43.299395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-50ec40b9-0646-42b9-892f-e623dc9e0f91 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:43.308167 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50ec40b9-0646-42b9-892f-e623dc9e0f91 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:43.311893 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50ec40b9-0646-42b9-892f-e623dc9e0f91 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:43.311893 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50ec40b9-0646-42b9-892f-e623dc9e0f91 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:43.311893 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50ec40b9-0646-42b9-892f-e623dc9e0f91 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:43.311893 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50ec40b9-0646-42b9-892f-e623dc9e0f91 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:43.312374 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50ec40b9-0646-42b9-892f-e623dc9e0f91 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:43.400200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-25c7a0a3-3f5e-4181-a6f3-330196037d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813629 Sep 08 14:01:43.401557 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 120/242] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:01:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:01:43.413115 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-29b00a31-a9ad-4c8b-9106-23921472597c tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:43.414186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-29b00a31-a9ad-4c8b-9106-23921472597c tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:43.539803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-50ec40b9-0646-42b9-892f-e623dc9e0f91 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:43.549536 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-50ec40b9-0646-42b9-892f-e623dc9e0f91 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.255361 Sep 08 14:01:43.550124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 123/243] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:43 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:43.668397 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-29b00a31-a9ad-4c8b-9106-23921472597c tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:43.676287 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-29b00a31-a9ad-4c8b-9106-23921472597c tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1214 microversion: 2.1 time: 0.267169 Sep 08 14:01:43.676862 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 121/244] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:43 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1214 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:44.573124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-89ef6e53-d672-4651-ba77-94ca6fbe2c0e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:44.574407 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-89ef6e53-d672-4651-ba77-94ca6fbe2c0e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:44.582990 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89ef6e53-d672-4651-ba77-94ca6fbe2c0e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:44.583422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89ef6e53-d672-4651-ba77-94ca6fbe2c0e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:44.584007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89ef6e53-d672-4651-ba77-94ca6fbe2c0e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:44.584762 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89ef6e53-d672-4651-ba77-94ca6fbe2c0e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:44.585214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89ef6e53-d672-4651-ba77-94ca6fbe2c0e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:44.585634 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89ef6e53-d672-4651-ba77-94ca6fbe2c0e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:44.699611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-bd5f6dcb-1aec-4182-9e57-c25ebeaafd4a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:44.700231 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-bd5f6dcb-1aec-4182-9e57-c25ebeaafd4a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:44.790839 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-89ef6e53-d672-4651-ba77-94ca6fbe2c0e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:44.802702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-89ef6e53-d672-4651-ba77-94ca6fbe2c0e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.233665 Sep 08 14:01:44.806687 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 124/245] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:44 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:44.862718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-bd5f6dcb-1aec-4182-9e57-c25ebeaafd4a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:44.872906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-bd5f6dcb-1aec-4182-9e57-c25ebeaafd4a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1214 microversion: 2.1 time: 0.177177 Sep 08 14:01:44.873931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 122/246] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:44 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:45.834241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-77a38ac1-d01e-472f-b240-251ab85b2662 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:45.837055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-77a38ac1-d01e-472f-b240-251ab85b2662 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:45.851185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77a38ac1-d01e-472f-b240-251ab85b2662 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:45.851797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77a38ac1-d01e-472f-b240-251ab85b2662 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:45.852330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77a38ac1-d01e-472f-b240-251ab85b2662 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:45.853039 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77a38ac1-d01e-472f-b240-251ab85b2662 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:45.853663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77a38ac1-d01e-472f-b240-251ab85b2662 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:45.854093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77a38ac1-d01e-472f-b240-251ab85b2662 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:46.020272 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-17af6d41-1b36-4223-988c-d0679a4c9dab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Action: 'create', calling method: .version_select at 0x7f52001059d0>, body: {"keypair": {"name": "tempest-keypair-288998548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsB4Nx3TQlOYuIw3w8YlNFNR5obz8OvNJwMy1u3AE+j1EkiCkHLlzkdB1x4N91ZbOgyPliy3B6gDOWhxXFoHcnKJ6hi+UBZLzK2OyU7b5rhKPlnJrvLUzaw2obuRk6RQw=="}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:46.039894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-17af6d41-1b36-4223-988c-d0679a4c9dab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Getting quotas for project a9448ca7c8234f74b24c8f6710a0ef5c. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:01:46.044378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-17af6d41-1b36-4223-988c-d0679a4c9dab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Getting quotas for user 48bf6dab289545bb80182c8904c05d6c and project a9448ca7c8234f74b24c8f6710a0ef5c. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:01:46.146283 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-17af6d41-1b36-4223-988c-d0679a4c9dab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.304845 Sep 08 14:01:46.150924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 123/247] 10.222.0.91 () {62 vars in 1200 bytes} [Thu Sep 8 14:01:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 310 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 08 14:01:46.172839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-05621968-b045-4db3-840d-f7780c251888 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:46.174065 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-05621968-b045-4db3-840d-f7780c251888 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:46.180927 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-05621968-b045-4db3-840d-f7780c251888 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:46.181761 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-05621968-b045-4db3-840d-f7780c251888 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:46.182417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-05621968-b045-4db3-840d-f7780c251888 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:46.183368 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-05621968-b045-4db3-840d-f7780c251888 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:46.184272 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-05621968-b045-4db3-840d-f7780c251888 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:46.184904 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-05621968-b045-4db3-840d-f7780c251888 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:46.255581 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-05621968-b045-4db3-840d-f7780c251888 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:46.265059 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-05621968-b045-4db3-840d-f7780c251888 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1266 microversion: 2.1 time: 0.097017 Sep 08 14:01:46.265667 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 124/248] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:46 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:46.345282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-77a38ac1-d01e-472f-b240-251ab85b2662 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:46.352773 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-77a38ac1-d01e-472f-b240-251ab85b2662 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.523501 Sep 08 14:01:46.353361 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 125/249] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:45 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:47.290292 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3ddd6cf6-fe46-4ab9-8033-61384d683a90 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:47.291200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3ddd6cf6-fe46-4ab9-8033-61384d683a90 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:47.297820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ddd6cf6-fe46-4ab9-8033-61384d683a90 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:47.298306 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ddd6cf6-fe46-4ab9-8033-61384d683a90 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:47.303702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ddd6cf6-fe46-4ab9-8033-61384d683a90 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:47.303702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ddd6cf6-fe46-4ab9-8033-61384d683a90 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:47.303702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ddd6cf6-fe46-4ab9-8033-61384d683a90 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:47.303702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ddd6cf6-fe46-4ab9-8033-61384d683a90 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:47.376315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3ddd6cf6-fe46-4ab9-8033-61384d683a90 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:47.380528 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-001baee7-0fe7-461b-aa25-634c924a4b98 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:47.381472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-001baee7-0fe7-461b-aa25-634c924a4b98 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:47.388033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3ddd6cf6-fe46-4ab9-8033-61384d683a90 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1266 microversion: 2.1 time: 0.102034 Sep 08 14:01:47.389995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001baee7-0fe7-461b-aa25-634c924a4b98 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:47.397183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 125/250] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:47 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:47.397437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001baee7-0fe7-461b-aa25-634c924a4b98 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:47.397437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001baee7-0fe7-461b-aa25-634c924a4b98 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:47.397437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001baee7-0fe7-461b-aa25-634c924a4b98 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:47.397437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001baee7-0fe7-461b-aa25-634c924a4b98 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:47.397776 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001baee7-0fe7-461b-aa25-634c924a4b98 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:47.577166 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-001baee7-0fe7-461b-aa25-634c924a4b98 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:47.590050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-001baee7-0fe7-461b-aa25-634c924a4b98 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.212883 Sep 08 14:01:47.606927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 126/251] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:47 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:48.423342 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ace09b11-d1e6-4dc6-bd62-fcb972d36a10 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:48.424720 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ace09b11-d1e6-4dc6-bd62-fcb972d36a10 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:48.437418 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ace09b11-d1e6-4dc6-bd62-fcb972d36a10 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:48.444948 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ace09b11-d1e6-4dc6-bd62-fcb972d36a10 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:48.447943 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ace09b11-d1e6-4dc6-bd62-fcb972d36a10 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:48.449447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ace09b11-d1e6-4dc6-bd62-fcb972d36a10 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:48.453113 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ace09b11-d1e6-4dc6-bd62-fcb972d36a10 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:48.454075 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ace09b11-d1e6-4dc6-bd62-fcb972d36a10 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:48.557656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ace09b11-d1e6-4dc6-bd62-fcb972d36a10 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:48.573130 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ace09b11-d1e6-4dc6-bd62-fcb972d36a10 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1266 microversion: 2.1 time: 0.154644 Sep 08 14:01:48.575257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 126/252] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:48 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:48.617655 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f8a6d7ed-adac-475e-a640-278744aaca95 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:48.618419 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f8a6d7ed-adac-475e-a640-278744aaca95 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:48.625206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8a6d7ed-adac-475e-a640-278744aaca95 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:48.625686 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8a6d7ed-adac-475e-a640-278744aaca95 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:48.626115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8a6d7ed-adac-475e-a640-278744aaca95 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:48.626804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8a6d7ed-adac-475e-a640-278744aaca95 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:48.627293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8a6d7ed-adac-475e-a640-278744aaca95 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:48.627706 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f8a6d7ed-adac-475e-a640-278744aaca95 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:48.894467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-711956535", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f64a6c3-194c-4eee-8e56-9cce93d9920c"}], "security_groups": [{"name": "tempest-securitygroup--139228927"}], "key_name": "tempest-keypair-288998548", "user_data": "}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:48.898914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f8a6d7ed-adac-475e-a640-278744aaca95 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:48.912374 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f8a6d7ed-adac-475e-a640-278744aaca95 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.299320 Sep 08 14:01:48.913275 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 127/253] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:48 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:49.029375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] validate_networks() for [('2f64a6c3-194c-4eee-8e56-9cce93d9920c', None, None, None, None, None)] {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:01:49.507795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:01:49.509132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:01:49.509608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:01:49.510333 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:01:49.511217 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:01:49.518070 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:49.527121 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.527838 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.528471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.529765 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.530514 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.531278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.549349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Getting quotas for project a9448ca7c8234f74b24c8f6710a0ef5c. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:01:49.554380 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Getting quotas for user 48bf6dab289545bb80182c8904c05d6c and project a9448ca7c8234f74b24c8f6710a0ef5c. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:01:49.568666 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:01:49.570875 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:01:49.601194 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c5a78cec-a501-4e91-b257-8667fd13bc7a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:49.601911 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c5a78cec-a501-4e91-b257-8667fd13bc7a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:49.607922 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c5a78cec-a501-4e91-b257-8667fd13bc7a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.608413 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c5a78cec-a501-4e91-b257-8667fd13bc7a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.608842 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c5a78cec-a501-4e91-b257-8667fd13bc7a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.610070 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c5a78cec-a501-4e91-b257-8667fd13bc7a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.610556 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c5a78cec-a501-4e91-b257-8667fd13bc7a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.611387 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c5a78cec-a501-4e91-b257-8667fd13bc7a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.688638 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c5a78cec-a501-4e91-b257-8667fd13bc7a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:49.692347 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c5a78cec-a501-4e91-b257-8667fd13bc7a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1284 microversion: 2.1 time: 0.096132 Sep 08 14:01:49.693091 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 128/254] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:49 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:49.708617 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c51bda30-81ed-4fe7-94ae-854737e82f13 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:49.709438 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c51bda30-81ed-4fe7-94ae-854737e82f13 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:49.716871 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51bda30-81ed-4fe7-94ae-854737e82f13 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.717364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51bda30-81ed-4fe7-94ae-854737e82f13 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.717803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51bda30-81ed-4fe7-94ae-854737e82f13 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.718504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51bda30-81ed-4fe7-94ae-854737e82f13 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.719023 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51bda30-81ed-4fe7-94ae-854737e82f13 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.719475 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c51bda30-81ed-4fe7-94ae-854737e82f13 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.745109 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c51bda30-81ed-4fe7-94ae-854737e82f13 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/ips" status: 200 len: 147 microversion: 2.1 time: 0.042796 Sep 08 14:01:49.745818 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-10f99eae-29d8-457f-8fd0-fe5fe6449f1e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.856258 Sep 08 14:01:49.746182 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 129/255] 10.222.0.91 () {58 vars in 1248 bytes} [Thu Sep 8 14:01:49 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:01:49.747882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 127/256] 10.222.0.91 () {62 vars in 1188 bytes} [Thu Sep 8 14:01:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 14:01:49.765204 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-965ef40f-bbdc-4b1c-aeb6-6c571fd750ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:49.768280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-965ef40f-bbdc-4b1c-aeb6-6c571fd750ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:49.832573 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-965ef40f-bbdc-4b1c-aeb6-6c571fd750ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:49.840961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-965ef40f-bbdc-4b1c-aeb6-6c571fd750ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:49.842536 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-965ef40f-bbdc-4b1c-aeb6-6c571fd750ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:49.843919 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-965ef40f-bbdc-4b1c-aeb6-6c571fd750ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1280 microversion: 2.20 time: 0.082371 Sep 08 14:01:49.852584 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 130/257] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:49 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:49.941918 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6724ca8b-9e49-498e-8b47-82bdcfe3e1d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:49.942415 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6724ca8b-9e49-498e-8b47-82bdcfe3e1d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:49.948644 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6724ca8b-9e49-498e-8b47-82bdcfe3e1d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.949105 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6724ca8b-9e49-498e-8b47-82bdcfe3e1d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.949585 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6724ca8b-9e49-498e-8b47-82bdcfe3e1d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.950276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6724ca8b-9e49-498e-8b47-82bdcfe3e1d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.950713 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6724ca8b-9e49-498e-8b47-82bdcfe3e1d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.951148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6724ca8b-9e49-498e-8b47-82bdcfe3e1d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:50.085586 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6724ca8b-9e49-498e-8b47-82bdcfe3e1d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:50.093270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6724ca8b-9e49-498e-8b47-82bdcfe3e1d4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1521 microversion: 2.1 time: 0.161545 Sep 08 14:01:50.109443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 128/258] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:49 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:50.717767 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-750b8dc3-b86c-42a0-9d60-d8d2eb61eece tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:50.718382 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-750b8dc3-b86c-42a0-9d60-d8d2eb61eece tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:50.735785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-750b8dc3-b86c-42a0-9d60-d8d2eb61eece tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:50.736492 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-750b8dc3-b86c-42a0-9d60-d8d2eb61eece tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:50.737087 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-750b8dc3-b86c-42a0-9d60-d8d2eb61eece tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:50.737987 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-750b8dc3-b86c-42a0-9d60-d8d2eb61eece tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:50.739461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-750b8dc3-b86c-42a0-9d60-d8d2eb61eece tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:50.739461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-750b8dc3-b86c-42a0-9d60-d8d2eb61eece tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:50.871086 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-37c4159b-b5ad-46d3-8dfe-a7a0991b4d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:50.872440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-37c4159b-b5ad-46d3-8dfe-a7a0991b4d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:50.897644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-750b8dc3-b86c-42a0-9d60-d8d2eb61eece tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:50.910671 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-750b8dc3-b86c-42a0-9d60-d8d2eb61eece tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1272 microversion: 2.1 time: 0.196528 Sep 08 14:01:50.911548 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 131/259] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:50 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:50.960223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-37c4159b-b5ad-46d3-8dfe-a7a0991b4d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:50.970373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-37c4159b-b5ad-46d3-8dfe-a7a0991b4d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:50.973958 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-37c4159b-b5ad-46d3-8dfe-a7a0991b4d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:50.977197 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-37c4159b-b5ad-46d3-8dfe-a7a0991b4d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1280 microversion: 2.20 time: 0.109584 Sep 08 14:01:50.978983 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 129/260] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:50 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1280 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:01:51.131807 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f596351f-4ee5-4a6d-b308-b8d311e13e16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:51.132636 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f596351f-4ee5-4a6d-b308-b8d311e13e16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:51.139299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f596351f-4ee5-4a6d-b308-b8d311e13e16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:51.139994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f596351f-4ee5-4a6d-b308-b8d311e13e16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:51.140450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f596351f-4ee5-4a6d-b308-b8d311e13e16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:51.141459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f596351f-4ee5-4a6d-b308-b8d311e13e16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:51.141942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f596351f-4ee5-4a6d-b308-b8d311e13e16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:51.142257 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f596351f-4ee5-4a6d-b308-b8d311e13e16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:51.354349 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f596351f-4ee5-4a6d-b308-b8d311e13e16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:51.363995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f596351f-4ee5-4a6d-b308-b8d311e13e16 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1501 microversion: 2.1 time: 0.236851 Sep 08 14:01:51.364597 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 132/261] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:51 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1501 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:51.391793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8d40a29d-cf2c-4fd2-a194-e7902383a9d9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:51.392724 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8d40a29d-cf2c-4fd2-a194-e7902383a9d9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:51.399239 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8d40a29d-cf2c-4fd2-a194-e7902383a9d9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:51.399978 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8d40a29d-cf2c-4fd2-a194-e7902383a9d9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:51.400398 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8d40a29d-cf2c-4fd2-a194-e7902383a9d9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:51.401535 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8d40a29d-cf2c-4fd2-a194-e7902383a9d9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:51.402137 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8d40a29d-cf2c-4fd2-a194-e7902383a9d9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:51.402559 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8d40a29d-cf2c-4fd2-a194-e7902383a9d9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:51.583545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8d40a29d-cf2c-4fd2-a194-e7902383a9d9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:51.591812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8d40a29d-cf2c-4fd2-a194-e7902383a9d9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1515 microversion: 2.1 time: 0.203806 Sep 08 14:01:51.592418 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 130/262] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:51 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:51.937461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ea9c13b4-bd7f-4a5d-901d-0523e864f61b tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:51.938262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ea9c13b4-bd7f-4a5d-901d-0523e864f61b tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:51.947295 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ea9c13b4-bd7f-4a5d-901d-0523e864f61b tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:51.948309 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ea9c13b4-bd7f-4a5d-901d-0523e864f61b tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:51.949601 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ea9c13b4-bd7f-4a5d-901d-0523e864f61b tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:51.951188 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ea9c13b4-bd7f-4a5d-901d-0523e864f61b tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:51.951826 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ea9c13b4-bd7f-4a5d-901d-0523e864f61b tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:51.952954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ea9c13b4-bd7f-4a5d-901d-0523e864f61b tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:52.003472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:52.005316 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:52.017746 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:52.018597 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:52.019270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:52.021502 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:52.022552 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:52.023252 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:52.106959 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:52.122060 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:52.123606 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:52.124914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-aba30992-5ee1-498f-bb7d-fffc9b7f7d3f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1332 microversion: 2.20 time: 0.125883 Sep 08 14:01:52.127766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 131/263] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:51 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:01:52.176952 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ea9c13b4-bd7f-4a5d-901d-0523e864f61b tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:52.197481 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ea9c13b4-bd7f-4a5d-901d-0523e864f61b tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.263835 Sep 08 14:01:52.198076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 133/264] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:51 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:52.872627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-7bd2e9a2-de73-4d29-8d4c-5ead59a1f4bc req-8fb518f0-ff53-4444-bdb0-4a539825b48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a061b60-6814-43e0-b647-e2e5e4241917", "tag": "6f39be53-5583-4b68-b9e9-436518116a76"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:52.883082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-7bd2e9a2-de73-4d29-8d4c-5ead59a1f4bc req-8fb518f0-ff53-4444-bdb0-4a539825b48e service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:52.883576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-7bd2e9a2-de73-4d29-8d4c-5ead59a1f4bc req-8fb518f0-ff53-4444-bdb0-4a539825b48e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:52.883995 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-7bd2e9a2-de73-4d29-8d4c-5ead59a1f4bc req-8fb518f0-ff53-4444-bdb0-4a539825b48e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:52.897493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-7bd2e9a2-de73-4d29-8d4c-5ead59a1f4bc req-8fb518f0-ff53-4444-bdb0-4a539825b48e service nova] Creating event network-changed:6f39be53-5583-4b68-b9e9-436518116a76 for instance 9a061b60-6814-43e0-b647-e2e5e4241917 on hv-cinder-84773 Sep 08 14:01:52.906483 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-7bd2e9a2-de73-4d29-8d4c-5ead59a1f4bc req-8fb518f0-ff53-4444-bdb0-4a539825b48e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037166 Sep 08 14:01:52.906921 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 132/265] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:53.134594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4840941a-b991-4e60-a8a1-8af4b5f4d134 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:53.134594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4840941a-b991-4e60-a8a1-8af4b5f4d134 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:53.138341 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4840941a-b991-4e60-a8a1-8af4b5f4d134 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:53.138836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4840941a-b991-4e60-a8a1-8af4b5f4d134 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:53.139300 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4840941a-b991-4e60-a8a1-8af4b5f4d134 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:53.140026 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4840941a-b991-4e60-a8a1-8af4b5f4d134 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:53.140474 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4840941a-b991-4e60-a8a1-8af4b5f4d134 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:53.141068 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4840941a-b991-4e60-a8a1-8af4b5f4d134 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:53.165131 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:53.166139 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:53.173286 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4840941a-b991-4e60-a8a1-8af4b5f4d134 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/ips" status: 200 len: 150 microversion: 2.1 time: 0.048495 Sep 08 14:01:53.173528 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:53.173830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:53.174265 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:53.174931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 134/266] 10.222.0.91 () {58 vars in 1248 bytes} [Thu Sep 8 14:01:53 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:53.175532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:53.175997 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:53.176414 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:53.225986 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-85d72f5f-d130-47a1-a7e8-3c400116c2bb tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:53.227306 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-85d72f5f-d130-47a1-a7e8-3c400116c2bb tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:53.234177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85d72f5f-d130-47a1-a7e8-3c400116c2bb tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:53.234177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85d72f5f-d130-47a1-a7e8-3c400116c2bb tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:53.235134 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85d72f5f-d130-47a1-a7e8-3c400116c2bb tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:53.236205 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85d72f5f-d130-47a1-a7e8-3c400116c2bb tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:53.236833 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85d72f5f-d130-47a1-a7e8-3c400116c2bb tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:53.237261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-85d72f5f-d130-47a1-a7e8-3c400116c2bb tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:53.275665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:53.292591 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:53.295021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:53.296704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-10e4c149-0c79-49f2-80db-299f1125ef7a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1340 microversion: 2.20 time: 0.136372 Sep 08 14:01:53.311338 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 133/267] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:53 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1340 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:53.400413 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-85d72f5f-d130-47a1-a7e8-3c400116c2bb tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:53.413157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-85d72f5f-d130-47a1-a7e8-3c400116c2bb tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.189677 Sep 08 14:01:53.413157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 135/268] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:53 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:54.322687 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:54.323447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:54.330200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:54.330779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:54.331253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:54.331956 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:54.332545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:54.332873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:54.338973 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:54.415455 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:54.424079 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:54.425583 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:54.427580 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-fb0683c3-725d-4025-852c-0ba94cbbc490 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1340 microversion: 2.20 time: 0.108881 Sep 08 14:01:54.428614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 134/269] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:54 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1340 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:54.433486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7f8e824c-f4e3-493d-8915-c9145d85c955 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:54.435715 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7f8e824c-f4e3-493d-8915-c9145d85c955 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:54.445718 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f8e824c-f4e3-493d-8915-c9145d85c955 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:54.446215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f8e824c-f4e3-493d-8915-c9145d85c955 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:54.447236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f8e824c-f4e3-493d-8915-c9145d85c955 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:54.447964 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f8e824c-f4e3-493d-8915-c9145d85c955 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:54.448422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f8e824c-f4e3-493d-8915-c9145d85c955 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:54.448838 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f8e824c-f4e3-493d-8915-c9145d85c955 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:54.594343 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7f8e824c-f4e3-493d-8915-c9145d85c955 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:54.602606 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7f8e824c-f4e3-493d-8915-c9145d85c955 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.175145 Sep 08 14:01:54.603805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 136/270] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:54 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:55.469038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:55.470413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:55.476975 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:55.477524 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:55.478239 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:55.479066 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:55.479620 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:55.481720 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:55.554630 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:55.564963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:55.566578 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:55.567742 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9ba5be54-cdac-445e-ba13-b09a318ae437 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1340 microversion: 2.20 time: 0.102762 Sep 08 14:01:55.573027 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 135/271] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:55 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:55.625283 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b3f41eaa-9bda-46b0-8325-2e75b997e430 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:55.625923 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b3f41eaa-9bda-46b0-8325-2e75b997e430 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:55.628182 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=54 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:55.632850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b3f41eaa-9bda-46b0-8325-2e75b997e430 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:55.633334 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b3f41eaa-9bda-46b0-8325-2e75b997e430 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:55.634215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b3f41eaa-9bda-46b0-8325-2e75b997e430 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:55.634941 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b3f41eaa-9bda-46b0-8325-2e75b997e430 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:55.635418 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b3f41eaa-9bda-46b0-8325-2e75b997e430 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:55.635965 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b3f41eaa-9bda-46b0-8325-2e75b997e430 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:56.098089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b3f41eaa-9bda-46b0-8325-2e75b997e430 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:56.102917 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=100 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:56.109786 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b3f41eaa-9bda-46b0-8325-2e75b997e430 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.486757 Sep 08 14:01:56.111916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 137/272] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:55 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:56.597659 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:56.598400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:56.604637 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:56.605206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:56.607468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:56.607468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:56.607468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:56.607468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:56.881592 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:56.893527 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:56.895380 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:56.896736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7f4ba19a-b5b3-422c-aee6-d1c9da422a13 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.303260 Sep 08 14:01:56.897628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 136/273] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:56 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:56.992962 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6365a778-812f-4894-8abe-bf87fb8f1220 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:56.995479 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6365a778-812f-4894-8abe-bf87fb8f1220 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:57.002796 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6365a778-812f-4894-8abe-bf87fb8f1220 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:57.003480 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6365a778-812f-4894-8abe-bf87fb8f1220 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:57.003933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6365a778-812f-4894-8abe-bf87fb8f1220 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:57.004618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6365a778-812f-4894-8abe-bf87fb8f1220 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:57.005073 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6365a778-812f-4894-8abe-bf87fb8f1220 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:57.005492 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6365a778-812f-4894-8abe-bf87fb8f1220 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:57.033947 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-6365a778-812f-4894-8abe-bf87fb8f1220 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lazy-loading 'flavor' on Instance uuid e409e9dd-aae7-4cce-9c1f-2c449abf9093 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:01:57.121564 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-96c56c1d-388c-4357-9692-4579f60aacb8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "150774fe-8124-43ba-9a58-7690634aca85"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:57.132576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-96c56c1d-388c-4357-9692-4579f60aacb8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:57.132576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-96c56c1d-388c-4357-9692-4579f60aacb8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:57.132576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-96c56c1d-388c-4357-9692-4579f60aacb8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:57.132576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-96c56c1d-388c-4357-9692-4579f60aacb8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:57.133506 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-96c56c1d-388c-4357-9692-4579f60aacb8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:57.134066 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-96c56c1d-388c-4357-9692-4579f60aacb8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:57.134724 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-96c56c1d-388c-4357-9692-4579f60aacb8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:57.351697 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6365a778-812f-4894-8abe-bf87fb8f1220 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093/action" status: 200 len: 32 microversion: 2.1 time: 0.364263 Sep 08 14:01:57.352302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 138/274] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:01:56 2022] POST /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093/action => generated 32 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:01:57.357289 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ca608982-3df5-4c34-b97a-00235cbc40e3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:57.357977 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ca608982-3df5-4c34-b97a-00235cbc40e3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:57.364136 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca608982-3df5-4c34-b97a-00235cbc40e3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:57.364610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca608982-3df5-4c34-b97a-00235cbc40e3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:57.365149 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca608982-3df5-4c34-b97a-00235cbc40e3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:57.365842 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca608982-3df5-4c34-b97a-00235cbc40e3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:57.366377 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca608982-3df5-4c34-b97a-00235cbc40e3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:57.366802 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca608982-3df5-4c34-b97a-00235cbc40e3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:57.505422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ca608982-3df5-4c34-b97a-00235cbc40e3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:57.513323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ca608982-3df5-4c34-b97a-00235cbc40e3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.159898 Sep 08 14:01:57.513885 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 139/275] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:57 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:57.518980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c62b17a6-82bd-4f35-a4be-1412b938e1e4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:57.519573 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c62b17a6-82bd-4f35-a4be-1412b938e1e4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:57.525549 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c62b17a6-82bd-4f35-a4be-1412b938e1e4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:57.526014 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c62b17a6-82bd-4f35-a4be-1412b938e1e4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:57.526441 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c62b17a6-82bd-4f35-a4be-1412b938e1e4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:57.527194 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c62b17a6-82bd-4f35-a4be-1412b938e1e4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:57.527621 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c62b17a6-82bd-4f35-a4be-1412b938e1e4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:57.528043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c62b17a6-82bd-4f35-a4be-1412b938e1e4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:57.662032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c62b17a6-82bd-4f35-a4be-1412b938e1e4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:57.670020 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c62b17a6-82bd-4f35-a4be-1412b938e1e4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.155161 Sep 08 14:01:57.670590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 140/276] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:57 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:57.686011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f81c5041-7af9-470b-8a7a-5bf91c266b29 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9660be93-2c2d-4894-ac86-3f9ac6774db7"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:57.686011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f81c5041-7af9-470b-8a7a-5bf91c266b29 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:57.686011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f81c5041-7af9-470b-8a7a-5bf91c266b29 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:57.686011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f81c5041-7af9-470b-8a7a-5bf91c266b29 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:57.686395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f81c5041-7af9-470b-8a7a-5bf91c266b29 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:57.686395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f81c5041-7af9-470b-8a7a-5bf91c266b29 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:57.686395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f81c5041-7af9-470b-8a7a-5bf91c266b29 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:57.686395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f81c5041-7af9-470b-8a7a-5bf91c266b29 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:59.146663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f81c5041-7af9-470b-8a7a-5bf91c266b29 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.474736 Sep 08 14:01:59.147651 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 141/277] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:01:57 2022] POST /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/os-volume_attachments => generated 194 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:59.162144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:59.162144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:59.169480 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:59.170560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:59.171399 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:59.172221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:59.172729 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:59.173301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:59.355073 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:59.367487 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:59.369502 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:59.370649 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-fe7aac86-25b7-4221-9459-a71a97ef9caf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.222260 Sep 08 14:01:59.371231 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 142/278] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:59 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:59.376247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-353db81b-332a-4304-8413-44a5bf038e11 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:59.377595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-353db81b-332a-4304-8413-44a5bf038e11 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:59.384499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-353db81b-332a-4304-8413-44a5bf038e11 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:59.385290 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-353db81b-332a-4304-8413-44a5bf038e11 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:59.385785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-353db81b-332a-4304-8413-44a5bf038e11 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:59.386544 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-353db81b-332a-4304-8413-44a5bf038e11 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:59.387027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-353db81b-332a-4304-8413-44a5bf038e11 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:59.387651 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-353db81b-332a-4304-8413-44a5bf038e11 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:59.511077 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-96c56c1d-388c-4357-9692-4579f60aacb8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.392549 Sep 08 14:01:59.517920 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 137/279] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:01:57 2022] POST /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-volume_attachments => generated 194 bytes in 2397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:59.532144 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-06a44ad8-2f41-4f8b-afad-9bdf96ef33bf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:59.537158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-06a44ad8-2f41-4f8b-afad-9bdf96ef33bf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:59.544428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=4 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:59.552249 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06a44ad8-2f41-4f8b-afad-9bdf96ef33bf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:59.552249 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06a44ad8-2f41-4f8b-afad-9bdf96ef33bf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:59.552249 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06a44ad8-2f41-4f8b-afad-9bdf96ef33bf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:59.552249 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06a44ad8-2f41-4f8b-afad-9bdf96ef33bf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:59.552718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06a44ad8-2f41-4f8b-afad-9bdf96ef33bf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:59.552718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06a44ad8-2f41-4f8b-afad-9bdf96ef33bf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:59.581649 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-353db81b-332a-4304-8413-44a5bf038e11 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:59.590723 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-353db81b-332a-4304-8413-44a5bf038e11 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.218189 Sep 08 14:01:59.591345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 143/280] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:59 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:59.613805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-1020800e-2663-48a3-affc-892ddf039a6f req-54d74ef8-567b-4423-99c5-96f2555f1e7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ba16ca-2c31-48e8-853e-416c2c3bf1fd", "tag": "e0a16b6f-cb62-4645-9c10-fa91d5e04946"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:59.627530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-1020800e-2663-48a3-affc-892ddf039a6f req-54d74ef8-567b-4423-99c5-96f2555f1e7f service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:59.628159 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-1020800e-2663-48a3-affc-892ddf039a6f req-54d74ef8-567b-4423-99c5-96f2555f1e7f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:59.629129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-1020800e-2663-48a3-affc-892ddf039a6f req-54d74ef8-567b-4423-99c5-96f2555f1e7f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:59.643053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-1020800e-2663-48a3-affc-892ddf039a6f req-54d74ef8-567b-4423-99c5-96f2555f1e7f service nova] Creating event network-changed:e0a16b6f-cb62-4645-9c10-fa91d5e04946 for instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd on hv-cinder-84773 Sep 08 14:01:59.650192 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-1020800e-2663-48a3-affc-892ddf039a6f req-54d74ef8-567b-4423-99c5-96f2555f1e7f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040495 Sep 08 14:01:59.650822 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 144/281] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:59.765151 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-06a44ad8-2f41-4f8b-afad-9bdf96ef33bf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:59.773414 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-06a44ad8-2f41-4f8b-afad-9bdf96ef33bf tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.258385 Sep 08 14:01:59.773914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 138/282] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:59 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:00.397568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:00.410010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:00.410712 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:00.426004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:00.426004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:00.426004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:00.426004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:00.426386 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:00.426386 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:00.551709 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:00.560109 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:00.561587 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:00.562686 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d7a9e8c9-de86-465e-827a-509f38dd94d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.166082 Sep 08 14:02:00.563266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 145/283] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:00 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:00.614487 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-60e22660-3eeb-4f0f-8099-0551381746dc tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:00.616383 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-60e22660-3eeb-4f0f-8099-0551381746dc tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:00.622200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60e22660-3eeb-4f0f-8099-0551381746dc tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:00.622559 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60e22660-3eeb-4f0f-8099-0551381746dc tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:00.623158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60e22660-3eeb-4f0f-8099-0551381746dc tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:00.624092 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60e22660-3eeb-4f0f-8099-0551381746dc tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:00.624866 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60e22660-3eeb-4f0f-8099-0551381746dc tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:00.625471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60e22660-3eeb-4f0f-8099-0551381746dc tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:00.770850 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-60e22660-3eeb-4f0f-8099-0551381746dc tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:00.779148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-60e22660-3eeb-4f0f-8099-0551381746dc tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.168735 Sep 08 14:02:00.779728 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 139/284] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:00 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:00.797547 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-801eb15e-e8d6-4617-a457-8d4d05724c1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:00.798331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-801eb15e-e8d6-4617-a457-8d4d05724c1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:00.805608 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-801eb15e-e8d6-4617-a457-8d4d05724c1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:00.806122 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-801eb15e-e8d6-4617-a457-8d4d05724c1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:00.806741 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-801eb15e-e8d6-4617-a457-8d4d05724c1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:00.807640 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-801eb15e-e8d6-4617-a457-8d4d05724c1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:00.808074 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-801eb15e-e8d6-4617-a457-8d4d05724c1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:00.808521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-801eb15e-e8d6-4617-a457-8d4d05724c1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:00.941931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-801eb15e-e8d6-4617-a457-8d4d05724c1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:00.949945 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-801eb15e-e8d6-4617-a457-8d4d05724c1c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.156323 Sep 08 14:02:00.950585 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 146/285] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:00 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:01.588956 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:01.589554 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:01.591490 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=22 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:01.596593 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:01.597066 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:01.597496 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:01.598180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:01.598715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:01.599162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:01.749550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:01.758262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:01.759938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:01.761207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9c9661b0-92e6-4ff1-8773-697bf191ebbd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.176184 Sep 08 14:02:01.761764 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 140/286] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:01 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:01.802247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d8fc6079-7fbb-45bd-8df9-9cf33682a481 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:01.803043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d8fc6079-7fbb-45bd-8df9-9cf33682a481 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:01.809762 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8fc6079-7fbb-45bd-8df9-9cf33682a481 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:01.810256 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8fc6079-7fbb-45bd-8df9-9cf33682a481 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:01.810689 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8fc6079-7fbb-45bd-8df9-9cf33682a481 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:01.811430 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8fc6079-7fbb-45bd-8df9-9cf33682a481 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:01.811888 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8fc6079-7fbb-45bd-8df9-9cf33682a481 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:01.812311 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8fc6079-7fbb-45bd-8df9-9cf33682a481 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:01.951012 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d8fc6079-7fbb-45bd-8df9-9cf33682a481 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:01.960666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d8fc6079-7fbb-45bd-8df9-9cf33682a481 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.162365 Sep 08 14:02:01.961764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 147/287] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:01 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:01.975256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a5354976-252c-4463-9010-35df54d2c2bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:01.977184 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a5354976-252c-4463-9010-35df54d2c2bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:01.983924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a5354976-252c-4463-9010-35df54d2c2bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:01.984412 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a5354976-252c-4463-9010-35df54d2c2bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:01.984846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a5354976-252c-4463-9010-35df54d2c2bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:01.985543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a5354976-252c-4463-9010-35df54d2c2bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:01.985995 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a5354976-252c-4463-9010-35df54d2c2bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:01.986482 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a5354976-252c-4463-9010-35df54d2c2bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:02.116633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a5354976-252c-4463-9010-35df54d2c2bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:02.124339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a5354976-252c-4463-9010-35df54d2c2bc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.155062 Sep 08 14:02:02.124905 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 141/288] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:01 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:02.787983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:02.788601 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:02.794810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:02.795363 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:02.795996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:02.796574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:02.797032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:02.797461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:02.949591 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:02.958432 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:02.959991 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:02.961181 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a7b64ffc-dd7d-41a9-ae3b-7e37b3a93265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.177926 Sep 08 14:02:02.961738 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 148/289] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:02 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:02.984020 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0515af87-6621-4f8b-aed9-b4bb16b9aa6a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:02.984707 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0515af87-6621-4f8b-aed9-b4bb16b9aa6a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:02.992123 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0515af87-6621-4f8b-aed9-b4bb16b9aa6a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:02.992684 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0515af87-6621-4f8b-aed9-b4bb16b9aa6a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:02.993351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0515af87-6621-4f8b-aed9-b4bb16b9aa6a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:02.994150 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0515af87-6621-4f8b-aed9-b4bb16b9aa6a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:02.994800 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0515af87-6621-4f8b-aed9-b4bb16b9aa6a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:02.995377 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0515af87-6621-4f8b-aed9-b4bb16b9aa6a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:03.154445 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d183f516-da18-4935-9ea7-25974b6ad724 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:03.163390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d183f516-da18-4935-9ea7-25974b6ad724 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:03.178724 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0515af87-6621-4f8b-aed9-b4bb16b9aa6a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:03.181716 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d183f516-da18-4935-9ea7-25974b6ad724 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:03.182236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d183f516-da18-4935-9ea7-25974b6ad724 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:03.183103 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d183f516-da18-4935-9ea7-25974b6ad724 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:03.184042 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d183f516-da18-4935-9ea7-25974b6ad724 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:03.190363 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d183f516-da18-4935-9ea7-25974b6ad724 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:03.190363 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d183f516-da18-4935-9ea7-25974b6ad724 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:03.192719 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0515af87-6621-4f8b-aed9-b4bb16b9aa6a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.212278 Sep 08 14:02:03.193323 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 142/290] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:02 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:03.370039 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d183f516-da18-4935-9ea7-25974b6ad724 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:03.379152 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d183f516-da18-4935-9ea7-25974b6ad724 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.235006 Sep 08 14:02:03.379763 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 149/291] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:03 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:03.502541 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-f465a4ea-924d-4ebb-9483-69abad11108c req-780d230b-3fa7-4631-948e-cc5eb363292f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a061b60-6814-43e0-b647-e2e5e4241917", "name": "network-vif-plugged", "status": "completed", "tag": "6f39be53-5583-4b68-b9e9-436518116a76"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:03.514239 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f465a4ea-924d-4ebb-9483-69abad11108c req-780d230b-3fa7-4631-948e-cc5eb363292f service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:03.514754 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f465a4ea-924d-4ebb-9483-69abad11108c req-780d230b-3fa7-4631-948e-cc5eb363292f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:03.515209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f465a4ea-924d-4ebb-9483-69abad11108c req-780d230b-3fa7-4631-948e-cc5eb363292f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:03.528291 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-f465a4ea-924d-4ebb-9483-69abad11108c req-780d230b-3fa7-4631-948e-cc5eb363292f service nova] Creating event network-vif-plugged:6f39be53-5583-4b68-b9e9-436518116a76 for instance 9a061b60-6814-43e0-b647-e2e5e4241917 on hv-cinder-84773 Sep 08 14:02:03.533450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-f465a4ea-924d-4ebb-9483-69abad11108c req-780d230b-3fa7-4631-948e-cc5eb363292f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034955 Sep 08 14:02:03.534176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 143/292] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:03.989170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:03.989799 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:03.996811 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:03.997208 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:03.997642 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:03.998340 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:03.998796 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:03.999244 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:04.144009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:04.152418 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:04.154027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:04.155162 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e25989bb-7bda-4b25-baf6-ed3d226a3be2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.170536 Sep 08 14:02:04.155731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 150/293] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:03 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:04.217440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9231ac62-6b05-4101-9516-4650e2abd9f0 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:04.218129 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9231ac62-6b05-4101-9516-4650e2abd9f0 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:04.224898 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9231ac62-6b05-4101-9516-4650e2abd9f0 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:04.225636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9231ac62-6b05-4101-9516-4650e2abd9f0 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:04.226163 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9231ac62-6b05-4101-9516-4650e2abd9f0 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:04.226477 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9231ac62-6b05-4101-9516-4650e2abd9f0 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:04.226949 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9231ac62-6b05-4101-9516-4650e2abd9f0 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:04.227366 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9231ac62-6b05-4101-9516-4650e2abd9f0 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:04.359492 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9231ac62-6b05-4101-9516-4650e2abd9f0 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:04.367923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9231ac62-6b05-4101-9516-4650e2abd9f0 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.155158 Sep 08 14:02:04.368501 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 144/294] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:04 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:04.403366 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9d605eac-1353-480f-92b4-4d2bc12a3af4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:04.404082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9d605eac-1353-480f-92b4-4d2bc12a3af4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:04.410434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d605eac-1353-480f-92b4-4d2bc12a3af4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:04.410936 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d605eac-1353-480f-92b4-4d2bc12a3af4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:04.411369 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d605eac-1353-480f-92b4-4d2bc12a3af4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:04.422934 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d605eac-1353-480f-92b4-4d2bc12a3af4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:04.422934 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d605eac-1353-480f-92b4-4d2bc12a3af4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:04.422934 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d605eac-1353-480f-92b4-4d2bc12a3af4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:04.554785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9d605eac-1353-480f-92b4-4d2bc12a3af4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:04.560787 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:04.565476 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9d605eac-1353-480f-92b4-4d2bc12a3af4 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.166534 Sep 08 14:02:04.566094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 151/295] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:04 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:05.181158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:05.181860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:05.190699 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.191588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.192348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:05.193949 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.195029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.196284 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:05.343163 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:05.352540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:05.354046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:05.355403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-88e31cc5-8326-41f4-b7d1-fef1362f901d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.178460 Sep 08 14:02:05.356025 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 145/296] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:05 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:02:05.390164 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3cf3fa03-98f7-4f9d-a508-eb9e3bae7e55 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:05.390775 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3cf3fa03-98f7-4f9d-a508-eb9e3bae7e55 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:05.398346 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3cf3fa03-98f7-4f9d-a508-eb9e3bae7e55 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.401889 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3cf3fa03-98f7-4f9d-a508-eb9e3bae7e55 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.401889 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3cf3fa03-98f7-4f9d-a508-eb9e3bae7e55 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:05.401889 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3cf3fa03-98f7-4f9d-a508-eb9e3bae7e55 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.401889 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3cf3fa03-98f7-4f9d-a508-eb9e3bae7e55 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.402410 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3cf3fa03-98f7-4f9d-a508-eb9e3bae7e55 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:05.553271 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-a0b82999-7f3a-4385-a872-9e37d801365c req-04c9b4be-18e8-439a-aa8a-8519e4bae946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ba16ca-2c31-48e8-853e-416c2c3bf1fd", "name": "network-vif-plugged", "status": "completed", "tag": "e0a16b6f-cb62-4645-9c10-fa91d5e04946"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:05.562942 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-a0b82999-7f3a-4385-a872-9e37d801365c req-04c9b4be-18e8-439a-aa8a-8519e4bae946 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.563421 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-a0b82999-7f3a-4385-a872-9e37d801365c req-04c9b4be-18e8-439a-aa8a-8519e4bae946 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.563849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-a0b82999-7f3a-4385-a872-9e37d801365c req-04c9b4be-18e8-439a-aa8a-8519e4bae946 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:05.574787 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-a0b82999-7f3a-4385-a872-9e37d801365c req-04c9b4be-18e8-439a-aa8a-8519e4bae946 service nova] Creating event network-vif-plugged:e0a16b6f-cb62-4645-9c10-fa91d5e04946 for instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd on hv-cinder-84773 Sep 08 14:02:05.580262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-a0b82999-7f3a-4385-a872-9e37d801365c req-04c9b4be-18e8-439a-aa8a-8519e4bae946 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030123 Sep 08 14:02:05.581228 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 146/297] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:02:05.597939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1f3a4caf-a932-4401-84de-549628863f85 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:05.599226 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1f3a4caf-a932-4401-84de-549628863f85 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:05.604615 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3cf3fa03-98f7-4f9d-a508-eb9e3bae7e55 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:05.607140 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f3a4caf-a932-4401-84de-549628863f85 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.607694 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f3a4caf-a932-4401-84de-549628863f85 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.608099 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f3a4caf-a932-4401-84de-549628863f85 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:05.608801 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f3a4caf-a932-4401-84de-549628863f85 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.609418 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f3a4caf-a932-4401-84de-549628863f85 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.609847 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f3a4caf-a932-4401-84de-549628863f85 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:05.616057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3cf3fa03-98f7-4f9d-a508-eb9e3bae7e55 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1314 microversion: 2.1 time: 0.230017 Sep 08 14:02:05.622837 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 152/298] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:05 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:06.005566 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1f3a4caf-a932-4401-84de-549628863f85 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:06.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1f3a4caf-a932-4401-84de-549628863f85 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.422858 Sep 08 14:02:06.015002 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 147/299] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:05 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:06.381579 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:06.382103 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:06.388432 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:06.388908 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:06.389338 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:06.390025 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:06.390477 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:06.398838 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:06.519999 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:06.528823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:06.530296 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:06.531462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-35ba0b6e-32f2-47e8-af3c-fe31c6521238 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.154455 Sep 08 14:02:06.532021 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 153/300] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:06 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:06.639778 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ae395dd5-d34c-489f-8237-648fc7894676 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:06.640336 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ae395dd5-d34c-489f-8237-648fc7894676 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:06.646728 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ae395dd5-d34c-489f-8237-648fc7894676 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:06.647238 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ae395dd5-d34c-489f-8237-648fc7894676 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:06.647676 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ae395dd5-d34c-489f-8237-648fc7894676 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:06.648360 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ae395dd5-d34c-489f-8237-648fc7894676 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:06.648807 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ae395dd5-d34c-489f-8237-648fc7894676 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:06.649225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ae395dd5-d34c-489f-8237-648fc7894676 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:06.791482 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ae395dd5-d34c-489f-8237-648fc7894676 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:06.799386 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ae395dd5-d34c-489f-8237-648fc7894676 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1463 microversion: 2.1 time: 0.163540 Sep 08 14:02:06.799953 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 148/301] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:06 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:06.847433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b7dc3ebb-caad-4c9f-a851-f1250c030705 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:06.847929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b7dc3ebb-caad-4c9f-a851-f1250c030705 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:06.853838 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b7dc3ebb-caad-4c9f-a851-f1250c030705 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:06.854323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b7dc3ebb-caad-4c9f-a851-f1250c030705 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:06.854759 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b7dc3ebb-caad-4c9f-a851-f1250c030705 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:06.855482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b7dc3ebb-caad-4c9f-a851-f1250c030705 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:06.855936 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b7dc3ebb-caad-4c9f-a851-f1250c030705 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:06.860460 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b7dc3ebb-caad-4c9f-a851-f1250c030705 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:06.881765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b7dc3ebb-caad-4c9f-a851-f1250c030705 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Going to try to terminate instance {{(pid=133059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:02:07.037882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f366904c-02a6-4459-b353-bb5f2a605239 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:07.038493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f366904c-02a6-4459-b353-bb5f2a605239 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:07.049244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f366904c-02a6-4459-b353-bb5f2a605239 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:07.049735 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f366904c-02a6-4459-b353-bb5f2a605239 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:07.050175 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f366904c-02a6-4459-b353-bb5f2a605239 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:07.050868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f366904c-02a6-4459-b353-bb5f2a605239 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:07.051341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f366904c-02a6-4459-b353-bb5f2a605239 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:07.051767 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f366904c-02a6-4459-b353-bb5f2a605239 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:07.113736 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b7dc3ebb-caad-4c9f-a851-f1250c030705 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 204 len: 0 microversion: 2.1 time: 0.270581 Sep 08 14:02:07.114330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 154/302] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:02:06 2022] DELETE /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:02:07.125118 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-94048005-4a29-451d-b001-228cfabd9177 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:07.125827 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-94048005-4a29-451d-b001-228cfabd9177 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:07.132738 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94048005-4a29-451d-b001-228cfabd9177 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:07.133221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94048005-4a29-451d-b001-228cfabd9177 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:07.133661 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94048005-4a29-451d-b001-228cfabd9177 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:07.135914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94048005-4a29-451d-b001-228cfabd9177 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:07.135914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94048005-4a29-451d-b001-228cfabd9177 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:07.135914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-94048005-4a29-451d-b001-228cfabd9177 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:07.287438 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-94048005-4a29-451d-b001-228cfabd9177 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:07.296494 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-94048005-4a29-451d-b001-228cfabd9177 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1469 microversion: 2.1 time: 0.175845 Sep 08 14:02:07.297099 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 155/303] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:07 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:07.336649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f366904c-02a6-4459-b353-bb5f2a605239 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:07.344510 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f366904c-02a6-4459-b353-bb5f2a605239 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.310431 Sep 08 14:02:07.345074 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 149/304] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:07 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:07.557411 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:07.558018 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:07.565061 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:07.565550 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:07.565979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:07.566670 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:07.567262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:07.567685 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:07.698543 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:07.707308 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:07.708752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:07.709884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-cb1e1287-22d6-446a-ab5e-04864f5ad63e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.156413 Sep 08 14:02:07.710429 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 156/305] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:07 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:08.320505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-cb24064c-297b-47ee-a4fa-9b7bfa9bf0e7 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:08.321225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-cb24064c-297b-47ee-a4fa-9b7bfa9bf0e7 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:08.327630 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb24064c-297b-47ee-a4fa-9b7bfa9bf0e7 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:08.328102 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb24064c-297b-47ee-a4fa-9b7bfa9bf0e7 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:08.328584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb24064c-297b-47ee-a4fa-9b7bfa9bf0e7 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.329214 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb24064c-297b-47ee-a4fa-9b7bfa9bf0e7 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:08.329653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb24064c-297b-47ee-a4fa-9b7bfa9bf0e7 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:08.330110 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb24064c-297b-47ee-a4fa-9b7bfa9bf0e7 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.367912 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-937c8fd3-e0c7-4da9-be3c-940c83b9e519 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:08.368555 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-937c8fd3-e0c7-4da9-be3c-940c83b9e519 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:08.374841 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-937c8fd3-e0c7-4da9-be3c-940c83b9e519 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:08.375366 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-937c8fd3-e0c7-4da9-be3c-940c83b9e519 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:08.375808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-937c8fd3-e0c7-4da9-be3c-940c83b9e519 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.376507 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-937c8fd3-e0c7-4da9-be3c-940c83b9e519 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:08.377538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-937c8fd3-e0c7-4da9-be3c-940c83b9e519 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:08.378083 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-937c8fd3-e0c7-4da9-be3c-940c83b9e519 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.462209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-cb24064c-297b-47ee-a4fa-9b7bfa9bf0e7 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:08.465882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:08.470522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-cb24064c-297b-47ee-a4fa-9b7bfa9bf0e7 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1469 microversion: 2.1 time: 0.153774 Sep 08 14:02:08.471140 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 150/306] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:08 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:08.517862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-937c8fd3-e0c7-4da9-be3c-940c83b9e519 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:08.525620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-937c8fd3-e0c7-4da9-be3c-940c83b9e519 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.161615 Sep 08 14:02:08.526181 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 157/307] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:08 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:08.735204 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:08.735721 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:08.743258 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:08.743743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:08.744176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.744858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:08.745304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:08.745720 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.879942 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:08.888636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:08.890142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:08.891186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-16fdff33-4e18-4d3b-bcd6-d4770dcdc433 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.159981 Sep 08 14:02:08.891734 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 151/308] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:08 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:09.506139 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6695c6d2-2fda-430b-aaa9-e4dbbd834720 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:09.506750 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6695c6d2-2fda-430b-aaa9-e4dbbd834720 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:09.513935 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6695c6d2-2fda-430b-aaa9-e4dbbd834720 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.514505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6695c6d2-2fda-430b-aaa9-e4dbbd834720 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.514968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6695c6d2-2fda-430b-aaa9-e4dbbd834720 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:09.515733 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6695c6d2-2fda-430b-aaa9-e4dbbd834720 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.516186 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6695c6d2-2fda-430b-aaa9-e4dbbd834720 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.516611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6695c6d2-2fda-430b-aaa9-e4dbbd834720 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:09.548228 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-372d61ce-5959-4d96-8f7d-9eeee79331b2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:09.548807 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-372d61ce-5959-4d96-8f7d-9eeee79331b2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:09.555974 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-372d61ce-5959-4d96-8f7d-9eeee79331b2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.556453 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-372d61ce-5959-4d96-8f7d-9eeee79331b2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.556879 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-372d61ce-5959-4d96-8f7d-9eeee79331b2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:09.557565 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-372d61ce-5959-4d96-8f7d-9eeee79331b2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.558011 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-372d61ce-5959-4d96-8f7d-9eeee79331b2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.558423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-372d61ce-5959-4d96-8f7d-9eeee79331b2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:09.661422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-6695c6d2-2fda-430b-aaa9-e4dbbd834720 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:09.669616 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6695c6d2-2fda-430b-aaa9-e4dbbd834720 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1469 microversion: 2.1 time: 0.168648 Sep 08 14:02:09.670312 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 158/309] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:09 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:09.699254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-372d61ce-5959-4d96-8f7d-9eeee79331b2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:09.707637 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-372d61ce-5959-4d96-8f7d-9eeee79331b2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.163275 Sep 08 14:02:09.708201 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 152/310] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:09 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:09.920612 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:09.921534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:09.930823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.931340 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.931779 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:09.932480 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.933003 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.933410 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.064176 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:10.073266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:10.074745 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:10.075940 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-67a5c9a3-62e6-4c5f-840d-11f69e147192 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.162281 Sep 08 14:02:10.076500 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 159/311] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:09 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:10.692784 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3c571c1c-13c6-442e-8b7c-154a534a8d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:10.693400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3c571c1c-13c6-442e-8b7c-154a534a8d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:10.699985 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c571c1c-13c6-442e-8b7c-154a534a8d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.700470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c571c1c-13c6-442e-8b7c-154a534a8d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.700909 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c571c1c-13c6-442e-8b7c-154a534a8d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.701614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c571c1c-13c6-442e-8b7c-154a534a8d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.702099 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c571c1c-13c6-442e-8b7c-154a534a8d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.702525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c571c1c-13c6-442e-8b7c-154a534a8d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.733314 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7fb8dfbb-0771-4dec-ab35-80999ffdedae tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:10.737321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7fb8dfbb-0771-4dec-ab35-80999ffdedae tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:10.744593 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7fb8dfbb-0771-4dec-ab35-80999ffdedae tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.745152 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7fb8dfbb-0771-4dec-ab35-80999ffdedae tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.745841 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7fb8dfbb-0771-4dec-ab35-80999ffdedae tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.746632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7fb8dfbb-0771-4dec-ab35-80999ffdedae tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.747206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7fb8dfbb-0771-4dec-ab35-80999ffdedae tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.747844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7fb8dfbb-0771-4dec-ab35-80999ffdedae tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.858347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3c571c1c-13c6-442e-8b7c-154a534a8d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:10.868618 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3c571c1c-13c6-442e-8b7c-154a534a8d8e tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1469 microversion: 2.1 time: 0.180261 Sep 08 14:02:10.869589 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 153/312] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:10 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:10.920331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7fb8dfbb-0771-4dec-ab35-80999ffdedae tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:10.932900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7fb8dfbb-0771-4dec-ab35-80999ffdedae tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.204250 Sep 08 14:02:10.933469 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 160/313] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:10 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:11.102509 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:11.103222 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:11.109134 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.109615 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.110219 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.110930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.111996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.112416 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.251539 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:11.260171 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:11.261865 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:11.263039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f0f16630-c240-4a93-a45f-ec3184eb21a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.164602 Sep 08 14:02:11.263600 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 154/314] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:11 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:11.893549 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7575a220-a02c-4fa7-9c43-f880741eb6b3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:11.894493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7575a220-a02c-4fa7-9c43-f880741eb6b3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:11.910325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7575a220-a02c-4fa7-9c43-f880741eb6b3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.910325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7575a220-a02c-4fa7-9c43-f880741eb6b3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.910325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7575a220-a02c-4fa7-9c43-f880741eb6b3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.910325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7575a220-a02c-4fa7-9c43-f880741eb6b3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.910798 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7575a220-a02c-4fa7-9c43-f880741eb6b3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.910798 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7575a220-a02c-4fa7-9c43-f880741eb6b3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.956918 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a0af8c01-bccd-4b99-807d-c434fdbb905d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:11.957716 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a0af8c01-bccd-4b99-807d-c434fdbb905d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:11.975640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0af8c01-bccd-4b99-807d-c434fdbb905d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.976461 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0af8c01-bccd-4b99-807d-c434fdbb905d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.976813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0af8c01-bccd-4b99-807d-c434fdbb905d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.977891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0af8c01-bccd-4b99-807d-c434fdbb905d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.978093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0af8c01-bccd-4b99-807d-c434fdbb905d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.978749 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0af8c01-bccd-4b99-807d-c434fdbb905d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:12.072968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7575a220-a02c-4fa7-9c43-f880741eb6b3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.083741 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7575a220-a02c-4fa7-9c43-f880741eb6b3 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1469 microversion: 2.1 time: 0.194727 Sep 08 14:02:12.084366 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 161/315] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:11 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:12.142346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a0af8c01-bccd-4b99-807d-c434fdbb905d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.150930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a0af8c01-bccd-4b99-807d-c434fdbb905d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.198660 Sep 08 14:02:12.151496 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 155/316] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:11 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:12.289177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:12.289693 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:12.295730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:12.296217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:12.296655 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:12.297344 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:12.297807 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:12.298256 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:12.435607 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.444435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.446955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.447330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2bbe4434-a736-43a0-b5e7-44b5e73afbfb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1405 microversion: 2.20 time: 0.162153 Sep 08 14:02:12.448254 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 162/317] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:12 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:13.107927 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-122cbc78-34c6-49d8-a26c-4ebdefd4d0ef tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:13.108525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-122cbc78-34c6-49d8-a26c-4ebdefd4d0ef tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:13.115643 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-122cbc78-34c6-49d8-a26c-4ebdefd4d0ef tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.116209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-122cbc78-34c6-49d8-a26c-4ebdefd4d0ef tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.116567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-122cbc78-34c6-49d8-a26c-4ebdefd4d0ef tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.117347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-122cbc78-34c6-49d8-a26c-4ebdefd4d0ef tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.117799 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-122cbc78-34c6-49d8-a26c-4ebdefd4d0ef tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.118223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-122cbc78-34c6-49d8-a26c-4ebdefd4d0ef tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.178026 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ebe50987-bc08-4d19-b89e-9a35b905340d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:13.178926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ebe50987-bc08-4d19-b89e-9a35b905340d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:13.185424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe50987-bc08-4d19-b89e-9a35b905340d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.185915 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe50987-bc08-4d19-b89e-9a35b905340d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.186346 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe50987-bc08-4d19-b89e-9a35b905340d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.187322 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe50987-bc08-4d19-b89e-9a35b905340d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.187754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe50987-bc08-4d19-b89e-9a35b905340d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.188339 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe50987-bc08-4d19-b89e-9a35b905340d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.292297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-122cbc78-34c6-49d8-a26c-4ebdefd4d0ef tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:13.303363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-122cbc78-34c6-49d8-a26c-4ebdefd4d0ef tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1469 microversion: 2.1 time: 0.199145 Sep 08 14:02:13.304418 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 156/318] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:13 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:13.387105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ebe50987-bc08-4d19-b89e-9a35b905340d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:13.395303 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ebe50987-bc08-4d19-b89e-9a35b905340d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.222777 Sep 08 14:02:13.395868 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 163/319] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:13 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:13.477547 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:13.478157 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:13.485150 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.485150 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.485596 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.488527 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.488527 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.488527 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.759495 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:13.769955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:13.772186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:13.773552 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-df655328-e6c7-4063-aaa5-b43feadea5c3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1596 microversion: 2.20 time: 0.302900 Sep 08 14:02:13.774941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 157/320] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:13 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1596 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:13.807865 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-51a6681f-1a8c-462f-9bd8-da49db098bd5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:13.809008 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-51a6681f-1a8c-462f-9bd8-da49db098bd5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:13.817278 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51a6681f-1a8c-462f-9bd8-da49db098bd5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.817984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51a6681f-1a8c-462f-9bd8-da49db098bd5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.818628 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51a6681f-1a8c-462f-9bd8-da49db098bd5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.819476 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51a6681f-1a8c-462f-9bd8-da49db098bd5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.820032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51a6681f-1a8c-462f-9bd8-da49db098bd5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.820559 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51a6681f-1a8c-462f-9bd8-da49db098bd5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.939926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-51a6681f-1a8c-462f-9bd8-da49db098bd5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.140860 Sep 08 14:02:13.941110 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 164/321] 10.222.0.91 () {60 vars in 1316 bytes} [Thu Sep 8 14:02:13 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:02:14.135198 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-aa7257dd-39ea-4b7c-8153-834745e70bd6 req-09980bd7-d21e-4c2a-8745-d9d8076d372c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a061b60-6814-43e0-b647-e2e5e4241917", "name": "network-vif-deleted", "tag": "6f39be53-5583-4b68-b9e9-436518116a76"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:14.150760 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-aa7257dd-39ea-4b7c-8153-834745e70bd6 req-09980bd7-d21e-4c2a-8745-d9d8076d372c service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.151437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-aa7257dd-39ea-4b7c-8153-834745e70bd6 req-09980bd7-d21e-4c2a-8745-d9d8076d372c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.151871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-aa7257dd-39ea-4b7c-8153-834745e70bd6 req-09980bd7-d21e-4c2a-8745-d9d8076d372c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.167611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-aa7257dd-39ea-4b7c-8153-834745e70bd6 req-09980bd7-d21e-4c2a-8745-d9d8076d372c service nova] Creating event network-vif-deleted:6f39be53-5583-4b68-b9e9-436518116a76 for instance 9a061b60-6814-43e0-b647-e2e5e4241917 on hv-cinder-84773 Sep 08 14:02:14.173445 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-aa7257dd-39ea-4b7c-8153-834745e70bd6 req-09980bd7-d21e-4c2a-8745-d9d8076d372c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042944 Sep 08 14:02:14.174687 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 158/322] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:14.337071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f58ae6db-4d88-4355-96b6-f77bd3c15ef6 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:14.340594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f58ae6db-4d88-4355-96b6-f77bd3c15ef6 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:14.348680 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f58ae6db-4d88-4355-96b6-f77bd3c15ef6 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.349272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f58ae6db-4d88-4355-96b6-f77bd3c15ef6 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.349706 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f58ae6db-4d88-4355-96b6-f77bd3c15ef6 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.350482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f58ae6db-4d88-4355-96b6-f77bd3c15ef6 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.351050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f58ae6db-4d88-4355-96b6-f77bd3c15ef6 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.351536 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f58ae6db-4d88-4355-96b6-f77bd3c15ef6 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.421751 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-34036b16-8eb3-4c50-a979-ec9741e00070 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:14.423649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-34036b16-8eb3-4c50-a979-ec9741e00070 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:14.431616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34036b16-8eb3-4c50-a979-ec9741e00070 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.432682 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34036b16-8eb3-4c50-a979-ec9741e00070 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.435348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34036b16-8eb3-4c50-a979-ec9741e00070 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.435348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34036b16-8eb3-4c50-a979-ec9741e00070 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.435348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34036b16-8eb3-4c50-a979-ec9741e00070 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.435348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34036b16-8eb3-4c50-a979-ec9741e00070 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.480901 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f58ae6db-4d88-4355-96b6-f77bd3c15ef6 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:14.507397 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f58ae6db-4d88-4355-96b6-f77bd3c15ef6 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1299 microversion: 2.1 time: 0.176379 Sep 08 14:02:14.509083 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 165/323] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:14 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1299 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:14.518147 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-925570cb-a062-4c12-9198-94d4ec74e3f9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:14.532150 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-925570cb-a062-4c12-9198-94d4ec74e3f9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.533471 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-925570cb-a062-4c12-9198-94d4ec74e3f9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.533914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-925570cb-a062-4c12-9198-94d4ec74e3f9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.610281 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-925570cb-a062-4c12-9198-94d4ec74e3f9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Going to try to stop instance {{(pid=133059) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 14:02:14.629093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:14.670673 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-34036b16-8eb3-4c50-a979-ec9741e00070 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:14.693291 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-34036b16-8eb3-4c50-a979-ec9741e00070 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.275455 Sep 08 14:02:14.694476 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 159/324] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:14 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:14.813052 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-925570cb-a062-4c12-9198-94d4ec74e3f9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/action" status: 202 len: 0 microversion: 2.1 time: 0.302154 Sep 08 14:02:14.821900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 166/325] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:02:14 2022] POST /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:02:14.831223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4e6b5271-b29a-4c09-9da5-ee9ceb9506cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:14.832562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4e6b5271-b29a-4c09-9da5-ee9ceb9506cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:14.850834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e6b5271-b29a-4c09-9da5-ee9ceb9506cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.851371 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e6b5271-b29a-4c09-9da5-ee9ceb9506cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.855414 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e6b5271-b29a-4c09-9da5-ee9ceb9506cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.857667 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e6b5271-b29a-4c09-9da5-ee9ceb9506cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.858835 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e6b5271-b29a-4c09-9da5-ee9ceb9506cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.859847 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e6b5271-b29a-4c09-9da5-ee9ceb9506cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.079257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4e6b5271-b29a-4c09-9da5-ee9ceb9506cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:15.092211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4e6b5271-b29a-4c09-9da5-ee9ceb9506cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.268051 Sep 08 14:02:15.092782 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 160/326] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:14 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:15.535050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:15.535907 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:15.545555 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.546046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.546624 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.552457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.552457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.552457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.582933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.583460 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.584086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.584530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lazy-loading 'fault' on Instance uuid 9a061b60-6814-43e0-b647-e2e5e4241917 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:02:15.736501 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-eb113cbc-b3b5-4dc3-8dc5-66241b97893b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:15.737591 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-eb113cbc-b3b5-4dc3-8dc5-66241b97893b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:15.749364 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb113cbc-b3b5-4dc3-8dc5-66241b97893b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.749364 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb113cbc-b3b5-4dc3-8dc5-66241b97893b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.753327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb113cbc-b3b5-4dc3-8dc5-66241b97893b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.754510 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb113cbc-b3b5-4dc3-8dc5-66241b97893b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.755535 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb113cbc-b3b5-4dc3-8dc5-66241b97893b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.756278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb113cbc-b3b5-4dc3-8dc5-66241b97893b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.775337 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb363a951f149438ddcd4ab8b819429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f63c1ffd86d4bd1aa5989c9bb6d850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:15.789548 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-fc8212d4-6424-48ed-b16f-5c1b019080e1 tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 200 len: 1304 microversion: 2.1 time: 0.259227 Sep 08 14:02:15.803847 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 167/327] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:15 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 1304 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:15.913313 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-122504c6-6643-4a31-bf12-2e6ae7c109d3 req-1b5ea1dc-6e1a-499a-94a7-f2cf7250f759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ba16ca-2c31-48e8-853e-416c2c3bf1fd", "tag": "e0a16b6f-cb62-4645-9c10-fa91d5e04946"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:15.932829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-122504c6-6643-4a31-bf12-2e6ae7c109d3 req-1b5ea1dc-6e1a-499a-94a7-f2cf7250f759 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.934727 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-122504c6-6643-4a31-bf12-2e6ae7c109d3 req-1b5ea1dc-6e1a-499a-94a7-f2cf7250f759 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.935433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-122504c6-6643-4a31-bf12-2e6ae7c109d3 req-1b5ea1dc-6e1a-499a-94a7-f2cf7250f759 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.950823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-122504c6-6643-4a31-bf12-2e6ae7c109d3 req-1b5ea1dc-6e1a-499a-94a7-f2cf7250f759 service nova] Creating event network-changed:e0a16b6f-cb62-4645-9c10-fa91d5e04946 for instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd on hv-cinder-84773 Sep 08 14:02:15.961510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-122504c6-6643-4a31-bf12-2e6ae7c109d3 req-1b5ea1dc-6e1a-499a-94a7-f2cf7250f759 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065516 Sep 08 14:02:15.963000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 168/328] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:02:16.022441 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-eb113cbc-b3b5-4dc3-8dc5-66241b97893b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:16.047294 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-eb113cbc-b3b5-4dc3-8dc5-66241b97893b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.303883 Sep 08 14:02:16.047934 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 161/329] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:15 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:16.135416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c3f234a4-df17-4be0-a156-60b7076643b5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:16.140245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c3f234a4-df17-4be0-a156-60b7076643b5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:16.177803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c3f234a4-df17-4be0-a156-60b7076643b5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.178619 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c3f234a4-df17-4be0-a156-60b7076643b5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.183992 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c3f234a4-df17-4be0-a156-60b7076643b5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.185570 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c3f234a4-df17-4be0-a156-60b7076643b5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.186771 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c3f234a4-df17-4be0-a156-60b7076643b5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.187711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c3f234a4-df17-4be0-a156-60b7076643b5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.455425 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c3f234a4-df17-4be0-a156-60b7076643b5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:16.467786 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c3f234a4-df17-4be0-a156-60b7076643b5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.343378 Sep 08 14:02:16.469113 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 169/330] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:16 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:16.833710 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:16.834524 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] [instance: 9a061b60-6814-43e0-b647-e2e5e4241917] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:16.841358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.841931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.843095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.844023 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.844677 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.845224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.872638 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] HTTP exception thrown: Instance 9a061b60-6814-43e0-b647-e2e5e4241917 could not be found. Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Request method failure captured: Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 HTTP/1.1 Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfXDRnU1QGF206-9ASs_ph_HES1Yp6BdCZjda51WQts0LgrtJa4AAbkq9glqU-WlXNuneL_Ui0rCHV41ekWl2lOAftQ40yptHTKMZafzNBuCSXTbHu_VG4V0Qt3LNUjsZNUyQaii-QrL4M0q4PYAv80V7wt9BNRebISfgmbBPGxtleQ Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 2f63c1ffd86d4bd1aa5989c9bb6d850f Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-VolumesNegativeTest-39382754 Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:02:16.875833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2f63c1ffd86d4bd1aa5989c9bb6d850f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/2f63c1ffd86d4bd1aa5989c9bb6d850f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_2f63c1ffd86d4bd1aa5989c9bb6d850f", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2f63c1ffd86d4bd1aa5989c9bb6d850f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-VolumesNegativeTest-39382754 Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 2f63c1ffd86d4bd1aa5989c9bb6d850f Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-VolumesNegativeTest-39382754 Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-VolumesNegativeTest-39382754-project Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: bfb363a951f149438ddcd4ab8b819429 Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-VolumesNegativeTest-39382754-project Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 9a061b60-6814-43e0-b647-e2e5e4241917 could not be found. Sep 08 14:02:16.879107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '9a061b60-6814-43e0-b647-e2e5e4241917'} Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a061b60-6814-43e0-b647-e2e5e4241917 could not be found. Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:02:16.880511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a061b60-6814-43e0-b647-e2e5e4241917 could not be found. Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a061b60-6814-43e0-b647-e2e5e4241917 could not be found. Sep 08 14:02:16.886962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:02:16.890869 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] Returning 404 to user: Instance 9a061b60-6814-43e0-b647-e2e5e4241917 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:02:16.892981 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c713d13f-878e-44a8-baf8-6d7f2013d73a tempest-VolumesNegativeTest-39382754 tempest-VolumesNegativeTest-39382754-project] 10.222.0.91 "GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917" status: 404 len: 111 microversion: 2.1 time: 0.061905 Sep 08 14:02:16.894024 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 162/331] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:16 2022] GET /compute/v2.1/servers/9a061b60-6814-43e0-b647-e2e5e4241917 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:02:17.058935 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b881a498-c4ca-430c-ac15-1a6c80c9b841 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:17.060325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b881a498-c4ca-430c-ac15-1a6c80c9b841 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:17.068058 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b881a498-c4ca-430c-ac15-1a6c80c9b841 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.068557 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b881a498-c4ca-430c-ac15-1a6c80c9b841 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.069556 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b881a498-c4ca-430c-ac15-1a6c80c9b841 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.069762 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b881a498-c4ca-430c-ac15-1a6c80c9b841 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.070123 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b881a498-c4ca-430c-ac15-1a6c80c9b841 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.070538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b881a498-c4ca-430c-ac15-1a6c80c9b841 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.291200 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b881a498-c4ca-430c-ac15-1a6c80c9b841 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:17.300173 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b881a498-c4ca-430c-ac15-1a6c80c9b841 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.246243 Sep 08 14:02:17.301755 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 170/332] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:17 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:17.497430 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-bd4f514d-8e1e-487d-b810-495c4b60666d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:17.504403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-bd4f514d-8e1e-487d-b810-495c4b60666d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:17.506255 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd4f514d-8e1e-487d-b810-495c4b60666d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.506802 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd4f514d-8e1e-487d-b810-495c4b60666d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.507255 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd4f514d-8e1e-487d-b810-495c4b60666d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.508099 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd4f514d-8e1e-487d-b810-495c4b60666d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.508562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd4f514d-8e1e-487d-b810-495c4b60666d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.508980 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd4f514d-8e1e-487d-b810-495c4b60666d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.696532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-bd4f514d-8e1e-487d-b810-495c4b60666d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:17.706051 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-bd4f514d-8e1e-487d-b810-495c4b60666d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.212457 Sep 08 14:02:17.706656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 163/333] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:17 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:18.331102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1853280d-d9a4-4683-a89c-38f88c2f2bf6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:18.331889 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1853280d-d9a4-4683-a89c-38f88c2f2bf6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:18.339803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1853280d-d9a4-4683-a89c-38f88c2f2bf6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:18.340821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1853280d-d9a4-4683-a89c-38f88c2f2bf6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:18.341468 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1853280d-d9a4-4683-a89c-38f88c2f2bf6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:18.342369 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1853280d-d9a4-4683-a89c-38f88c2f2bf6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:18.343163 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1853280d-d9a4-4683-a89c-38f88c2f2bf6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:18.343754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1853280d-d9a4-4683-a89c-38f88c2f2bf6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:18.929236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1853280d-d9a4-4683-a89c-38f88c2f2bf6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:18.929236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1853280d-d9a4-4683-a89c-38f88c2f2bf6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.186839 Sep 08 14:02:18.929236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 171/334] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:18 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:18.934162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2aa1e5af-03c5-4034-8fb2-169d8829a4d4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:18.934162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2aa1e5af-03c5-4034-8fb2-169d8829a4d4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:18.934162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2aa1e5af-03c5-4034-8fb2-169d8829a4d4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:18.934162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2aa1e5af-03c5-4034-8fb2-169d8829a4d4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:18.935723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2aa1e5af-03c5-4034-8fb2-169d8829a4d4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:18.935723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2aa1e5af-03c5-4034-8fb2-169d8829a4d4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:18.935723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2aa1e5af-03c5-4034-8fb2-169d8829a4d4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:18.935723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2aa1e5af-03c5-4034-8fb2-169d8829a4d4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:18.936397 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2aa1e5af-03c5-4034-8fb2-169d8829a4d4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:18.936397 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2aa1e5af-03c5-4034-8fb2-169d8829a4d4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.177590 Sep 08 14:02:18.936397 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 164/335] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:18 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:19.541495 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f386dfba-b4cb-411b-a5dd-23a6bc1d0a47 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:19.542298 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f386dfba-b4cb-411b-a5dd-23a6bc1d0a47 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:19.548750 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f386dfba-b4cb-411b-a5dd-23a6bc1d0a47 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.549233 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f386dfba-b4cb-411b-a5dd-23a6bc1d0a47 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.549681 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f386dfba-b4cb-411b-a5dd-23a6bc1d0a47 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.550377 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f386dfba-b4cb-411b-a5dd-23a6bc1d0a47 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.550829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f386dfba-b4cb-411b-a5dd-23a6bc1d0a47 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.551281 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f386dfba-b4cb-411b-a5dd-23a6bc1d0a47 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.698816 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f386dfba-b4cb-411b-a5dd-23a6bc1d0a47 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:19.707014 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f386dfba-b4cb-411b-a5dd-23a6bc1d0a47 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.170039 Sep 08 14:02:19.707578 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 172/336] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:19 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:19.933552 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7b32bb71-6f80-4185-87e3-0b49326957fe tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:19.934161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7b32bb71-6f80-4185-87e3-0b49326957fe tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:19.936633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:19.942009 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7b32bb71-6f80-4185-87e3-0b49326957fe tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.942493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7b32bb71-6f80-4185-87e3-0b49326957fe tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.942966 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7b32bb71-6f80-4185-87e3-0b49326957fe tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.943663 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7b32bb71-6f80-4185-87e3-0b49326957fe tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.944122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7b32bb71-6f80-4185-87e3-0b49326957fe tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.944643 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7b32bb71-6f80-4185-87e3-0b49326957fe tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.092826 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7b32bb71-6f80-4185-87e3-0b49326957fe tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:20.101275 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7b32bb71-6f80-4185-87e3-0b49326957fe tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.171704 Sep 08 14:02:20.101834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 165/337] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:19 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:20.733085 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-92f307c5-0d7c-4dd9-a307-154a68c5728b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:20.733883 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-92f307c5-0d7c-4dd9-a307-154a68c5728b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:20.741363 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-92f307c5-0d7c-4dd9-a307-154a68c5728b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.741929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-92f307c5-0d7c-4dd9-a307-154a68c5728b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.742618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-92f307c5-0d7c-4dd9-a307-154a68c5728b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.743697 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-92f307c5-0d7c-4dd9-a307-154a68c5728b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.744210 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-92f307c5-0d7c-4dd9-a307-154a68c5728b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.744682 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-92f307c5-0d7c-4dd9-a307-154a68c5728b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.884180 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-92f307c5-0d7c-4dd9-a307-154a68c5728b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:20.900512 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-92f307c5-0d7c-4dd9-a307-154a68c5728b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.171982 Sep 08 14:02:20.901348 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 173/338] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:20 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:21.125209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-813273a8-ab2e-42cf-90ca-3d7782a4a1cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:21.125812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-813273a8-ab2e-42cf-90ca-3d7782a4a1cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:21.134844 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-813273a8-ab2e-42cf-90ca-3d7782a4a1cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:21.140352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-813273a8-ab2e-42cf-90ca-3d7782a4a1cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:21.140352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-813273a8-ab2e-42cf-90ca-3d7782a4a1cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:21.140352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-813273a8-ab2e-42cf-90ca-3d7782a4a1cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:21.140352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-813273a8-ab2e-42cf-90ca-3d7782a4a1cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:21.141032 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-813273a8-ab2e-42cf-90ca-3d7782a4a1cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:21.292730 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-813273a8-ab2e-42cf-90ca-3d7782a4a1cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:21.303875 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-813273a8-ab2e-42cf-90ca-3d7782a4a1cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.182724 Sep 08 14:02:21.304470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 166/339] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:21 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:21.924019 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-91b84af1-72b1-4701-8a35-a40e8d38f88c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:21.924767 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-91b84af1-72b1-4701-8a35-a40e8d38f88c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:21.932240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b84af1-72b1-4701-8a35-a40e8d38f88c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:21.932811 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b84af1-72b1-4701-8a35-a40e8d38f88c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:21.933502 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b84af1-72b1-4701-8a35-a40e8d38f88c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:21.934415 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b84af1-72b1-4701-8a35-a40e8d38f88c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:21.934883 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b84af1-72b1-4701-8a35-a40e8d38f88c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:21.935561 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b84af1-72b1-4701-8a35-a40e8d38f88c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.120131 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-91b84af1-72b1-4701-8a35-a40e8d38f88c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:22.138355 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-91b84af1-72b1-4701-8a35-a40e8d38f88c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.218193 Sep 08 14:02:22.139377 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 174/340] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:21 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:22.342500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4e7b41d7-1bbc-4317-9d9f-1c24f2dfb355 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:22.343375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4e7b41d7-1bbc-4317-9d9f-1c24f2dfb355 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:22.351453 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e7b41d7-1bbc-4317-9d9f-1c24f2dfb355 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:22.351942 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e7b41d7-1bbc-4317-9d9f-1c24f2dfb355 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:22.352384 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e7b41d7-1bbc-4317-9d9f-1c24f2dfb355 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.353435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e7b41d7-1bbc-4317-9d9f-1c24f2dfb355 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:22.353892 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e7b41d7-1bbc-4317-9d9f-1c24f2dfb355 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:22.354317 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4e7b41d7-1bbc-4317-9d9f-1c24f2dfb355 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.599755 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4e7b41d7-1bbc-4317-9d9f-1c24f2dfb355 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:22.622118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4e7b41d7-1bbc-4317-9d9f-1c24f2dfb355 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.283813 Sep 08 14:02:22.637279 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 167/341] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:22 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:23.166959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-95975446-6099-4126-9acd-0a36227a335c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:23.167814 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-95975446-6099-4126-9acd-0a36227a335c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:23.178317 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-95975446-6099-4126-9acd-0a36227a335c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:23.178880 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-95975446-6099-4126-9acd-0a36227a335c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:23.179553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-95975446-6099-4126-9acd-0a36227a335c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:23.180395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-95975446-6099-4126-9acd-0a36227a335c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:23.180980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-95975446-6099-4126-9acd-0a36227a335c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:23.181444 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-95975446-6099-4126-9acd-0a36227a335c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:23.356687 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-95975446-6099-4126-9acd-0a36227a335c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:23.365275 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-95975446-6099-4126-9acd-0a36227a335c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.202774 Sep 08 14:02:23.365959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 175/342] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:23 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:23.614935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-082ba11b-0de6-418b-87e7-bf2840e3663f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: .version_select at 0x7f52002de0d0>, body: {"keypair": {"name": "tempest-keypair-1032411369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvqol7cDop8VwNp0+J1gpwMxMHVo1HG+hpotpartTyte15fuInUIHN4ESIxQsNn6V8vVg0bAJMDif/IpWoIcorULqANhLHsjXqCAqXKNCP3Nn92J7FLvG4R2NuEJZ69pQ=="}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:23.635071 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-082ba11b-0de6-418b-87e7-bf2840e3663f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:23.639368 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-082ba11b-0de6-418b-87e7-bf2840e3663f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for user beb41eb66e8140a6999b0bddab3c4afd and project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:23.658792 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b0bc3577-f737-44cb-82ef-42f318faa5df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:23.658792 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b0bc3577-f737-44cb-82ef-42f318faa5df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:23.682947 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b0bc3577-f737-44cb-82ef-42f318faa5df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:23.687257 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b0bc3577-f737-44cb-82ef-42f318faa5df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:23.687257 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b0bc3577-f737-44cb-82ef-42f318faa5df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:23.687257 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b0bc3577-f737-44cb-82ef-42f318faa5df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:23.687257 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b0bc3577-f737-44cb-82ef-42f318faa5df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:23.687862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b0bc3577-f737-44cb-82ef-42f318faa5df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:23.762138 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-082ba11b-0de6-418b-87e7-bf2840e3663f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154952 Sep 08 14:02:23.763868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 168/343] 10.222.0.91 () {60 vars in 1159 bytes} [Thu Sep 8 14:02:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:23.872967 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b0bc3577-f737-44cb-82ef-42f318faa5df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:23.881266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b0bc3577-f737-44cb-82ef-42f318faa5df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.238663 Sep 08 14:02:23.881934 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 176/344] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:23 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:24.390374 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0ac5b8ac-e4d3-43ad-9c46-3fc7701695ba tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:24.390855 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0ac5b8ac-e4d3-43ad-9c46-3fc7701695ba tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:24.400728 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac5b8ac-e4d3-43ad-9c46-3fc7701695ba tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:24.401425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac5b8ac-e4d3-43ad-9c46-3fc7701695ba tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:24.401883 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac5b8ac-e4d3-43ad-9c46-3fc7701695ba tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:24.402599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac5b8ac-e4d3-43ad-9c46-3fc7701695ba tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:24.403090 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac5b8ac-e4d3-43ad-9c46-3fc7701695ba tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:24.403520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac5b8ac-e4d3-43ad-9c46-3fc7701695ba tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:24.566157 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0ac5b8ac-e4d3-43ad-9c46-3fc7701695ba tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:24.569746 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:24.574450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0ac5b8ac-e4d3-43ad-9c46-3fc7701695ba tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.188433 Sep 08 14:02:24.575038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 169/345] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:24 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:24.905757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-395880f3-190f-4fff-8b5b-7ce92b7e745a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:24.906311 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-395880f3-190f-4fff-8b5b-7ce92b7e745a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:24.913058 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-395880f3-190f-4fff-8b5b-7ce92b7e745a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:24.913608 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-395880f3-190f-4fff-8b5b-7ce92b7e745a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:24.913983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-395880f3-190f-4fff-8b5b-7ce92b7e745a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:24.914698 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-395880f3-190f-4fff-8b5b-7ce92b7e745a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:24.915192 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-395880f3-190f-4fff-8b5b-7ce92b7e745a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:24.915613 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-395880f3-190f-4fff-8b5b-7ce92b7e745a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.102288 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-395880f3-190f-4fff-8b5b-7ce92b7e745a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:25.114802 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-395880f3-190f-4fff-8b5b-7ce92b7e745a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.213010 Sep 08 14:02:25.115738 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 177/346] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:24 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:25.599858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5bdec52f-7407-40e7-8300-6802b86a6806 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:25.601666 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5bdec52f-7407-40e7-8300-6802b86a6806 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:25.624228 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5bdec52f-7407-40e7-8300-6802b86a6806 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.624903 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5bdec52f-7407-40e7-8300-6802b86a6806 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.625350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5bdec52f-7407-40e7-8300-6802b86a6806 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.634694 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5bdec52f-7407-40e7-8300-6802b86a6806 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.635225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5bdec52f-7407-40e7-8300-6802b86a6806 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.635695 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5bdec52f-7407-40e7-8300-6802b86a6806 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.820377 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5bdec52f-7407-40e7-8300-6802b86a6806 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:25.829124 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5bdec52f-7407-40e7-8300-6802b86a6806 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1501 microversion: 2.1 time: 0.233991 Sep 08 14:02:25.829720 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 170/347] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:25 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1501 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:25.862915 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8143418-5944-4748-9510-fa76c67eaf67"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:25.869449 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:25.872712 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:25.876243 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.876743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.877324 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.878044 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.878499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.878954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.919528 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] HTTP exception thrown: Cannot 'attach_volume' instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 while it is in vm_state rescued Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Request method failure captured: Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: POST /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093/os-volume_attachments HTTP/1.1 Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 74 Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVgsfQZT4q-AwtAeupucKbXfT6LGhmAzk0Dk9cZxUYc9pYOGHXV1Q14F05ICSXDdtU9v7LTi5J7ETbJGcmHJfaoROm1DUxoD2jYhOI4CMw5zblbDb9kPtA9N8mZ9DNzz-JlYodYsTwDVzUjTQ2Ub9wQwAnZ04e_ENmxl0_puCWPkQE Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 2078beb45799497ea367c552b6d8bcf9 Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:02:25.924183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_2078beb45799497ea367c552b6d8bcf9", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 2078beb45799497ea367c552b6d8bcf9 Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-ServerRescueNegativeTestJSON-993995764-project Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: e4916206c2ff42669276e0a93d6483ab Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-993995764-project Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {"volumeAttachment": {"volumeId": "a8143418-5944-4748-9510-fa76c67eaf67"}} Sep 08 14:02:25.925760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Cannot 'attach_volume' instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 while it is in vm_state rescued Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'server_id': 'e409e9dd-aae7-4cce-9c1f-2c449abf9093', 'body': {'volumeAttachment': {'volumeId': 'a8143418-5944-4748-9510-fa76c67eaf67'}}} Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:02:25.926739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 while it is in vm_state rescued Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:25.927925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:25.929082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:02:25.929082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:02:25.929082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 while it is in vm_state rescued Sep 08 14:02:25.929082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:02:25.929082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Returning 409 to user: Cannot 'attach_volume' instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 while it is in vm_state rescued {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:02:25.929082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4d1ccb8b-2b7c-4f0f-bdeb-0c3c789bb237 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067659 Sep 08 14:02:25.929082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 178/348] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:02:25 2022] POST /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 14:02:25.935769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f799f15e-6d7f-4962-85e8-e772bf869dd7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:25.936557 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f799f15e-6d7f-4962-85e8-e772bf869dd7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:25.944388 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f799f15e-6d7f-4962-85e8-e772bf869dd7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.945117 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f799f15e-6d7f-4962-85e8-e772bf869dd7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.945726 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f799f15e-6d7f-4962-85e8-e772bf869dd7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.946609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f799f15e-6d7f-4962-85e8-e772bf869dd7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.947307 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f799f15e-6d7f-4962-85e8-e772bf869dd7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.947889 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f799f15e-6d7f-4962-85e8-e772bf869dd7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.150004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3ea43c5c-9787-4d73-a3e6-1f01c48f1f53 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:26.150004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3ea43c5c-9787-4d73-a3e6-1f01c48f1f53 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:26.150004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3ea43c5c-9787-4d73-a3e6-1f01c48f1f53 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.150004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3ea43c5c-9787-4d73-a3e6-1f01c48f1f53 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.151107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3ea43c5c-9787-4d73-a3e6-1f01c48f1f53 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.151107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3ea43c5c-9787-4d73-a3e6-1f01c48f1f53 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.151107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3ea43c5c-9787-4d73-a3e6-1f01c48f1f53 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.151107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3ea43c5c-9787-4d73-a3e6-1f01c48f1f53 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.236601 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f799f15e-6d7f-4962-85e8-e772bf869dd7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093/action" status: 202 len: 0 microversion: 2.1 time: 0.304804 Sep 08 14:02:26.237459 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 171/349] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:02:25 2022] POST /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:02:26.246662 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-09b56139-215b-4674-894d-d9ff191f6aee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:26.247293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-09b56139-215b-4674-894d-d9ff191f6aee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:26.255385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09b56139-215b-4674-894d-d9ff191f6aee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.258187 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09b56139-215b-4674-894d-d9ff191f6aee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.258187 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09b56139-215b-4674-894d-d9ff191f6aee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.258187 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09b56139-215b-4674-894d-d9ff191f6aee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.258187 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09b56139-215b-4674-894d-d9ff191f6aee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.258703 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09b56139-215b-4674-894d-d9ff191f6aee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.407496 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3ea43c5c-9787-4d73-a3e6-1f01c48f1f53 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:26.417879 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3ea43c5c-9787-4d73-a3e6-1f01c48f1f53 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.281723 Sep 08 14:02:26.422594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 179/350] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:26 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:26.507538 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-09b56139-215b-4674-894d-d9ff191f6aee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:26.517587 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-09b56139-215b-4674-894d-d9ff191f6aee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1509 microversion: 2.1 time: 0.274762 Sep 08 14:02:26.518470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 172/351] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:26 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:26.600872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-701623737", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38509184-249f-4b78-9ab0-339bc3caa638"}], "security_groups": [{"name": "tempest-securitygroup--373712486"}], "key_name": "tempest-keypair-1032411369", "user_data": "}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:26.741959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] validate_networks() for [('38509184-249f-4b78-9ab0-339bc3caa638', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:02:27.183321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:02:27.183973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:02:27.184234 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:02:27.184643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:02:27.185051 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:02:27.194590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.195167 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.195645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.196383 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.196845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.197268 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.217900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:27.225181 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for user beb41eb66e8140a6999b0bddab3c4afd and project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:27.240193 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:02:27.242513 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:02:27.401906 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a590598f-10c3-472b-aecb-f7ff679cef3b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.805671 Sep 08 14:02:27.402737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 180/352] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:02:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:02:27.413824 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-bd30fe61-bbfd-466e-8600-c1666dc83184 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:27.414431 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-bd30fe61-bbfd-466e-8600-c1666dc83184 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:27.458398 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-737ef094-d98f-4589-ab05-7114053ad641 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:27.459661 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-737ef094-d98f-4589-ab05-7114053ad641 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:27.470706 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-737ef094-d98f-4589-ab05-7114053ad641 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.473148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-737ef094-d98f-4589-ab05-7114053ad641 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.473582 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-737ef094-d98f-4589-ab05-7114053ad641 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.480254 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-737ef094-d98f-4589-ab05-7114053ad641 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.480254 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-737ef094-d98f-4589-ab05-7114053ad641 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.482784 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-737ef094-d98f-4589-ab05-7114053ad641 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.522640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-bd30fe61-bbfd-466e-8600-c1666dc83184 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:27.532694 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-bd30fe61-bbfd-466e-8600-c1666dc83184 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1241 microversion: 2.1 time: 0.121897 Sep 08 14:02:27.534043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 173/353] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:27 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:27.544382 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ce36ff4e-c06e-4487-9f42-02d3c0d1bff6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:27.546097 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ce36ff4e-c06e-4487-9f42-02d3c0d1bff6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:27.561569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ce36ff4e-c06e-4487-9f42-02d3c0d1bff6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.561569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ce36ff4e-c06e-4487-9f42-02d3c0d1bff6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.561569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ce36ff4e-c06e-4487-9f42-02d3c0d1bff6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.561569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ce36ff4e-c06e-4487-9f42-02d3c0d1bff6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.561998 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ce36ff4e-c06e-4487-9f42-02d3c0d1bff6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.562284 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ce36ff4e-c06e-4487-9f42-02d3c0d1bff6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.759333 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ce36ff4e-c06e-4487-9f42-02d3c0d1bff6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:27.773222 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ce36ff4e-c06e-4487-9f42-02d3c0d1bff6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1509 microversion: 2.1 time: 0.232466 Sep 08 14:02:27.790922 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-737ef094-d98f-4589-ab05-7114053ad641 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:27.801142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 174/354] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:27 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:27.803624 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-737ef094-d98f-4589-ab05-7114053ad641 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.353872 Sep 08 14:02:27.804473 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 181/355] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:27 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:28.571132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-aab78533-a23b-46ab-9650-4ec601b1be89 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:28.571915 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-aab78533-a23b-46ab-9650-4ec601b1be89 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:28.578481 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aab78533-a23b-46ab-9650-4ec601b1be89 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.579002 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aab78533-a23b-46ab-9650-4ec601b1be89 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.579495 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aab78533-a23b-46ab-9650-4ec601b1be89 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:28.580231 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aab78533-a23b-46ab-9650-4ec601b1be89 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.580685 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aab78533-a23b-46ab-9650-4ec601b1be89 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.581110 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aab78533-a23b-46ab-9650-4ec601b1be89 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:28.654488 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-aab78533-a23b-46ab-9650-4ec601b1be89 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:28.663781 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-aab78533-a23b-46ab-9650-4ec601b1be89 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1245 microversion: 2.1 time: 0.103136 Sep 08 14:02:28.664933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 175/356] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:28 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:28.808147 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f7ec6628-14c3-41a8-96de-a992eb5447cc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:28.810002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f7ec6628-14c3-41a8-96de-a992eb5447cc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:28.815876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7ec6628-14c3-41a8-96de-a992eb5447cc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.816354 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7ec6628-14c3-41a8-96de-a992eb5447cc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.816782 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7ec6628-14c3-41a8-96de-a992eb5447cc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:28.817482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7ec6628-14c3-41a8-96de-a992eb5447cc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.817935 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7ec6628-14c3-41a8-96de-a992eb5447cc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.818357 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7ec6628-14c3-41a8-96de-a992eb5447cc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:28.827990 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9c20421c-5d4b-4d32-8ee9-1546935b7300 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:28.829640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9c20421c-5d4b-4d32-8ee9-1546935b7300 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:28.837096 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c20421c-5d4b-4d32-8ee9-1546935b7300 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.838078 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c20421c-5d4b-4d32-8ee9-1546935b7300 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.838857 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c20421c-5d4b-4d32-8ee9-1546935b7300 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:28.840343 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c20421c-5d4b-4d32-8ee9-1546935b7300 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.841035 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c20421c-5d4b-4d32-8ee9-1546935b7300 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.841743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c20421c-5d4b-4d32-8ee9-1546935b7300 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:29.025014 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9c20421c-5d4b-4d32-8ee9-1546935b7300 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:29.034830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9c20421c-5d4b-4d32-8ee9-1546935b7300 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.210874 Sep 08 14:02:29.047888 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 176/357] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:28 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:29.133361 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f7ec6628-14c3-41a8-96de-a992eb5447cc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:29.142142 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f7ec6628-14c3-41a8-96de-a992eb5447cc tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1509 microversion: 2.1 time: 0.337839 Sep 08 14:02:29.158835 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 182/358] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:28 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:29.694016 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4693d635-9ca2-450b-90fb-b78aaf75144e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:29.695370 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4693d635-9ca2-450b-90fb-b78aaf75144e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:29.702542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4693d635-9ca2-450b-90fb-b78aaf75144e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:29.703123 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4693d635-9ca2-450b-90fb-b78aaf75144e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:29.703714 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4693d635-9ca2-450b-90fb-b78aaf75144e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:29.705130 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4693d635-9ca2-450b-90fb-b78aaf75144e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:29.705749 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4693d635-9ca2-450b-90fb-b78aaf75144e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:29.706324 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4693d635-9ca2-450b-90fb-b78aaf75144e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:29.775363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4693d635-9ca2-450b-90fb-b78aaf75144e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:29.783845 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4693d635-9ca2-450b-90fb-b78aaf75144e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1245 microversion: 2.1 time: 0.093713 Sep 08 14:02:29.784425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 177/359] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:29 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:30.073266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8d0b6d6f-3954-43b7-aee5-cabd5ec3388c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:30.073960 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8d0b6d6f-3954-43b7-aee5-cabd5ec3388c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:30.091268 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d0b6d6f-3954-43b7-aee5-cabd5ec3388c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.092089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d0b6d6f-3954-43b7-aee5-cabd5ec3388c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.092733 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d0b6d6f-3954-43b7-aee5-cabd5ec3388c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.094342 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d0b6d6f-3954-43b7-aee5-cabd5ec3388c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.096448 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d0b6d6f-3954-43b7-aee5-cabd5ec3388c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.099866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d0b6d6f-3954-43b7-aee5-cabd5ec3388c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.166553 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-11e95ce5-eb26-4695-aaa8-7b7921f5a307 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:30.167475 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-11e95ce5-eb26-4695-aaa8-7b7921f5a307 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:30.174360 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11e95ce5-eb26-4695-aaa8-7b7921f5a307 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.174850 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11e95ce5-eb26-4695-aaa8-7b7921f5a307 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.175305 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11e95ce5-eb26-4695-aaa8-7b7921f5a307 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.175994 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11e95ce5-eb26-4695-aaa8-7b7921f5a307 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.176443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11e95ce5-eb26-4695-aaa8-7b7921f5a307 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.176857 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11e95ce5-eb26-4695-aaa8-7b7921f5a307 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.336124 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-11e95ce5-eb26-4695-aaa8-7b7921f5a307 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:30.344497 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-11e95ce5-eb26-4695-aaa8-7b7921f5a307 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1515 microversion: 2.1 time: 0.181642 Sep 08 14:02:30.345963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 178/360] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:30 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:30.652094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8d0b6d6f-3954-43b7-aee5-cabd5ec3388c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:30.661157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8d0b6d6f-3954-43b7-aee5-cabd5ec3388c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.592793 Sep 08 14:02:30.661823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 183/361] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:30 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:30.811930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3897681d-0ebc-4055-802f-6c8176d9a625 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:30.812493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3897681d-0ebc-4055-802f-6c8176d9a625 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:30.819136 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3897681d-0ebc-4055-802f-6c8176d9a625 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.819624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3897681d-0ebc-4055-802f-6c8176d9a625 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.820053 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3897681d-0ebc-4055-802f-6c8176d9a625 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.821029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3897681d-0ebc-4055-802f-6c8176d9a625 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.821485 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3897681d-0ebc-4055-802f-6c8176d9a625 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.821906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3897681d-0ebc-4055-802f-6c8176d9a625 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.894759 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3897681d-0ebc-4055-802f-6c8176d9a625 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:30.908611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3897681d-0ebc-4055-802f-6c8176d9a625 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1293 microversion: 2.1 time: 0.102433 Sep 08 14:02:30.911407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 179/362] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:30 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:31.686874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-89bb361c-c556-45a0-944e-c4d51b7ab461 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:31.687500 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-89bb361c-c556-45a0-944e-c4d51b7ab461 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:31.694769 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89bb361c-c556-45a0-944e-c4d51b7ab461 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:31.695293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89bb361c-c556-45a0-944e-c4d51b7ab461 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:31.695719 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89bb361c-c556-45a0-944e-c4d51b7ab461 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:31.696407 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89bb361c-c556-45a0-944e-c4d51b7ab461 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:31.696851 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89bb361c-c556-45a0-944e-c4d51b7ab461 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:31.697267 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89bb361c-c556-45a0-944e-c4d51b7ab461 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:31.712956 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:31.902069 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-89bb361c-c556-45a0-944e-c4d51b7ab461 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:31.913226 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-89bb361c-c556-45a0-944e-c4d51b7ab461 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.230154 Sep 08 14:02:31.913815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 184/363] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:31 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:31.953015 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5b9bac6b-200a-4e35-94a4-122aa318ba6c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:31.955749 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5b9bac6b-200a-4e35-94a4-122aa318ba6c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:31.974006 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5b9bac6b-200a-4e35-94a4-122aa318ba6c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:31.974530 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5b9bac6b-200a-4e35-94a4-122aa318ba6c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:31.974962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5b9bac6b-200a-4e35-94a4-122aa318ba6c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:31.975665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5b9bac6b-200a-4e35-94a4-122aa318ba6c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:31.976110 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5b9bac6b-200a-4e35-94a4-122aa318ba6c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:31.976550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5b9bac6b-200a-4e35-94a4-122aa318ba6c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:32.087948 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5b9bac6b-200a-4e35-94a4-122aa318ba6c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:32.099548 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5b9bac6b-200a-4e35-94a4-122aa318ba6c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1301 microversion: 2.1 time: 0.157458 Sep 08 14:02:32.100598 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 180/364] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:31 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1301 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:32.355477 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-758edbee-9a23-4882-af48-ffc26788fd50 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'create', calling method: .version_select at 0x7f520037f0d0>, body: {"keypair": {"name": "tempest-keypair-940230966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAKgPqqv0VebdFbClC/ytXRrADpZpwjqsfxQ6iFL/pBKGRktFpjVQnIdQ7MzCNaXb8TfdXb9bVBBLIpLimtbtd5/osf9ebMrWa+TaLpyEnFgstNGq1TtDw0QwI3lanfSQ=="}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:32.385608 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-758edbee-9a23-4882-af48-ffc26788fd50 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Getting quotas for project 2078beb45799497ea367c552b6d8bcf9. Resources: {'key_pairs'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:32.395611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-758edbee-9a23-4882-af48-ffc26788fd50 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Getting quotas for user e4916206c2ff42669276e0a93d6483ab and project 2078beb45799497ea367c552b6d8bcf9. Resources: {'key_pairs'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:32.541984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-758edbee-9a23-4882-af48-ffc26788fd50 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190402 Sep 08 14:02:32.542704 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 185/365] 10.222.0.91 () {60 vars in 1159 bytes} [Thu Sep 8 14:02:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:32.949068 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c104eef4-3c49-4075-8078-18dfe1774f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:32.949686 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c104eef4-3c49-4075-8078-18dfe1774f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:32.957851 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c104eef4-3c49-4075-8078-18dfe1774f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:32.958515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c104eef4-3c49-4075-8078-18dfe1774f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:32.958762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c104eef4-3c49-4075-8078-18dfe1774f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:32.959506 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c104eef4-3c49-4075-8078-18dfe1774f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:32.959965 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c104eef4-3c49-4075-8078-18dfe1774f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:32.960975 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c104eef4-3c49-4075-8078-18dfe1774f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:33.126058 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e2bcb8aa-4edb-407c-a51f-1768e4dbcb6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:33.126939 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e2bcb8aa-4edb-407c-a51f-1768e4dbcb6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:33.135747 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e2bcb8aa-4edb-407c-a51f-1768e4dbcb6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:33.136325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e2bcb8aa-4edb-407c-a51f-1768e4dbcb6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:33.136828 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e2bcb8aa-4edb-407c-a51f-1768e4dbcb6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:33.138353 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e2bcb8aa-4edb-407c-a51f-1768e4dbcb6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:33.138353 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e2bcb8aa-4edb-407c-a51f-1768e4dbcb6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:33.138548 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e2bcb8aa-4edb-407c-a51f-1768e4dbcb6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:33.218297 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e2bcb8aa-4edb-407c-a51f-1768e4dbcb6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:33.226150 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e2bcb8aa-4edb-407c-a51f-1768e4dbcb6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1299 microversion: 2.1 time: 0.106403 Sep 08 14:02:33.226734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 186/366] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:33 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:33.280432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c104eef4-3c49-4075-8078-18dfe1774f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:33.293696 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c104eef4-3c49-4075-8078-18dfe1774f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.349343 Sep 08 14:02:33.294465 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 181/367] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:32 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:34.250661 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-65401446-ffcf-466b-a30d-bbfe4e659409 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:34.251944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-65401446-ffcf-466b-a30d-bbfe4e659409 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:34.258777 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-65401446-ffcf-466b-a30d-bbfe4e659409 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:34.259522 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-65401446-ffcf-466b-a30d-bbfe4e659409 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:34.260610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-65401446-ffcf-466b-a30d-bbfe4e659409 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:34.260858 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-65401446-ffcf-466b-a30d-bbfe4e659409 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:34.261634 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-65401446-ffcf-466b-a30d-bbfe4e659409 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:34.262051 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-65401446-ffcf-466b-a30d-bbfe4e659409 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:34.320499 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1480db6c-b908-4f21-b70f-ff4d4025e197 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:34.321619 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1480db6c-b908-4f21-b70f-ff4d4025e197 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:34.331304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1480db6c-b908-4f21-b70f-ff4d4025e197 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:34.332099 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1480db6c-b908-4f21-b70f-ff4d4025e197 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:34.332700 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1480db6c-b908-4f21-b70f-ff4d4025e197 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:34.335066 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1480db6c-b908-4f21-b70f-ff4d4025e197 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:34.335704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1480db6c-b908-4f21-b70f-ff4d4025e197 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:34.336340 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1480db6c-b908-4f21-b70f-ff4d4025e197 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:34.514799 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-65401446-ffcf-466b-a30d-bbfe4e659409 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:34.523160 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-65401446-ffcf-466b-a30d-bbfe4e659409 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1366 microversion: 2.1 time: 0.276757 Sep 08 14:02:34.523742 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 187/368] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:34 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:34.586548 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1480db6c-b908-4f21-b70f-ff4d4025e197 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:34.595148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1480db6c-b908-4f21-b70f-ff4d4025e197 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.281210 Sep 08 14:02:34.595835 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 182/369] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:34 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:35.517219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-b0c6c00c-1862-48fe-9b38-61bec630529e req-25c760b9-3107-4616-ab5c-17e96392db91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "175ddc71-f731-4fa7-8de5-245b36c3c13b", "tag": "3f1d12fa-8092-409f-bf87-a97dd8a63d43"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:35.526714 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-b0c6c00c-1862-48fe-9b38-61bec630529e req-25c760b9-3107-4616-ab5c-17e96392db91 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:35.527128 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-b0c6c00c-1862-48fe-9b38-61bec630529e req-25c760b9-3107-4616-ab5c-17e96392db91 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:35.527567 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-b0c6c00c-1862-48fe-9b38-61bec630529e req-25c760b9-3107-4616-ab5c-17e96392db91 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:35.550534 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7e9cdf56-4a41-43a9-b0a9-dcadc1a56cc4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:35.551390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7e9cdf56-4a41-43a9-b0a9-dcadc1a56cc4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:35.573127 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-b0c6c00c-1862-48fe-9b38-61bec630529e req-25c760b9-3107-4616-ab5c-17e96392db91 service nova] Creating event network-changed:3f1d12fa-8092-409f-bf87-a97dd8a63d43 for instance 175ddc71-f731-4fa7-8de5-245b36c3c13b on hv-cinder-84773 Sep 08 14:02:35.579894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e9cdf56-4a41-43a9-b0a9-dcadc1a56cc4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:35.580196 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e9cdf56-4a41-43a9-b0a9-dcadc1a56cc4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:35.580640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e9cdf56-4a41-43a9-b0a9-dcadc1a56cc4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:35.582406 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e9cdf56-4a41-43a9-b0a9-dcadc1a56cc4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:35.584757 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e9cdf56-4a41-43a9-b0a9-dcadc1a56cc4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:35.585512 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e9cdf56-4a41-43a9-b0a9-dcadc1a56cc4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:35.591513 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-b0c6c00c-1862-48fe-9b38-61bec630529e req-25c760b9-3107-4616-ab5c-17e96392db91 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082556 Sep 08 14:02:35.593637 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 188/370] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:35.622526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8466dc28-a75f-4310-a378-e5663cf18aca tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:35.623479 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8466dc28-a75f-4310-a378-e5663cf18aca tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:35.635301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8466dc28-a75f-4310-a378-e5663cf18aca tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:35.639639 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8466dc28-a75f-4310-a378-e5663cf18aca tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:35.640096 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8466dc28-a75f-4310-a378-e5663cf18aca tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:35.640863 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8466dc28-a75f-4310-a378-e5663cf18aca tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:35.641386 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8466dc28-a75f-4310-a378-e5663cf18aca tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:35.645398 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8466dc28-a75f-4310-a378-e5663cf18aca tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:35.835495 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8466dc28-a75f-4310-a378-e5663cf18aca tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:35.851828 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8466dc28-a75f-4310-a378-e5663cf18aca tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.233761 Sep 08 14:02:35.852436 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 189/371] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:35 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:36.123962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7e9cdf56-4a41-43a9-b0a9-dcadc1a56cc4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:36.139551 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7e9cdf56-4a41-43a9-b0a9-dcadc1a56cc4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1366 microversion: 2.1 time: 0.595173 Sep 08 14:02:36.156697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 183/372] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:35 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1366 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:36.897413 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-cbb53275-bac0-467d-ab9e-c0826c8c192e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:36.898734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-cbb53275-bac0-467d-ab9e-c0826c8c192e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:36.912809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cbb53275-bac0-467d-ab9e-c0826c8c192e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:36.915265 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cbb53275-bac0-467d-ab9e-c0826c8c192e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:36.917033 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cbb53275-bac0-467d-ab9e-c0826c8c192e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:36.919396 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cbb53275-bac0-467d-ab9e-c0826c8c192e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:36.919860 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cbb53275-bac0-467d-ab9e-c0826c8c192e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:36.920291 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cbb53275-bac0-467d-ab9e-c0826c8c192e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:37.170988 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-351cce02-be84-4dc1-8589-f6fc43faac3d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:37.170988 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-351cce02-be84-4dc1-8589-f6fc43faac3d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:37.177963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-351cce02-be84-4dc1-8589-f6fc43faac3d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:37.178833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-351cce02-be84-4dc1-8589-f6fc43faac3d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:37.179513 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-351cce02-be84-4dc1-8589-f6fc43faac3d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:37.180388 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-351cce02-be84-4dc1-8589-f6fc43faac3d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:37.181017 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-351cce02-be84-4dc1-8589-f6fc43faac3d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:37.181437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-351cce02-be84-4dc1-8589-f6fc43faac3d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:37.203804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-cbb53275-bac0-467d-ab9e-c0826c8c192e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:37.209234 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:37.215990 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-cbb53275-bac0-467d-ab9e-c0826c8c192e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.332983 Sep 08 14:02:37.217628 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 190/373] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:36 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:37.224291 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-706309377", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "955cd46c-55dd-4620-a904-f617035eddf3"}], "security_groups": [{"name": "tempest-securitygroup--1644915063"}], "key_name": "tempest-keypair-940230966", "user_data": "}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:37.378307 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-351cce02-be84-4dc1-8589-f6fc43faac3d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:37.392562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-351cce02-be84-4dc1-8589-f6fc43faac3d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1366 microversion: 2.1 time: 0.229742 Sep 08 14:02:37.393178 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 184/374] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:37 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:37.448015 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] validate_networks() for [('955cd46c-55dd-4620-a904-f617035eddf3', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:02:38.243904 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-24208f66-e592-454e-ab8d-329c8c391e94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:38.245098 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-24208f66-e592-454e-ab8d-329c8c391e94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:38.247231 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=6 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:38.253620 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24208f66-e592-454e-ab8d-329c8c391e94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:38.254109 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24208f66-e592-454e-ab8d-329c8c391e94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:38.254542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24208f66-e592-454e-ab8d-329c8c391e94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:38.255349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24208f66-e592-454e-ab8d-329c8c391e94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:38.255974 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24208f66-e592-454e-ab8d-329c8c391e94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:38.256436 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24208f66-e592-454e-ab8d-329c8c391e94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:38.343757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:02:38.344807 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:02:38.346057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:02:38.346694 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:02:38.347336 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:02:38.359410 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:38.360797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:38.361564 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:38.362778 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:38.363503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:38.364213 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:38.394226 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Getting quotas for project 2078beb45799497ea367c552b6d8bcf9. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:38.402402 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Getting quotas for user e4916206c2ff42669276e0a93d6483ab and project 2078beb45799497ea367c552b6d8bcf9. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:38.417931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:02:38.420888 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:02:38.538525 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8a4b170d-08b4-428b-b626-1b3d434bc103 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.318957 Sep 08 14:02:38.539614 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 191/375] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:02:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:02:38.544354 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-56fac413-44db-4a2b-ae8e-36ca24b8cafb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:38.544959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-56fac413-44db-4a2b-ae8e-36ca24b8cafb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:38.553069 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-56fac413-44db-4a2b-ae8e-36ca24b8cafb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:38.553860 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-56fac413-44db-4a2b-ae8e-36ca24b8cafb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:38.554564 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-56fac413-44db-4a2b-ae8e-36ca24b8cafb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:38.555314 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-56fac413-44db-4a2b-ae8e-36ca24b8cafb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:38.555929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-56fac413-44db-4a2b-ae8e-36ca24b8cafb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:38.556356 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-56fac413-44db-4a2b-ae8e-36ca24b8cafb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:38.665777 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-24208f66-e592-454e-ab8d-329c8c391e94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:38.675306 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-24208f66-e592-454e-ab8d-329c8c391e94 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.436793 Sep 08 14:02:38.675906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 185/376] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:38 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:38.681253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-094f991b-6af2-47df-93ee-650d6020b284 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:38.681858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-094f991b-6af2-47df-93ee-650d6020b284 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:38.742298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-094f991b-6af2-47df-93ee-650d6020b284 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:38.756308 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-094f991b-6af2-47df-93ee-650d6020b284 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1244 microversion: 2.1 time: 0.078859 Sep 08 14:02:38.756902 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 186/377] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:38 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1244 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:38.810848 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-56fac413-44db-4a2b-ae8e-36ca24b8cafb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:38.836439 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-56fac413-44db-4a2b-ae8e-36ca24b8cafb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1366 microversion: 2.1 time: 0.294000 Sep 08 14:02:38.838839 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 192/378] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:38 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:39.697661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-711f1df4-d14b-4664-b6ed-dae2d073824c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:39.698266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-711f1df4-d14b-4664-b6ed-dae2d073824c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:39.705747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-711f1df4-d14b-4664-b6ed-dae2d073824c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.706229 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-711f1df4-d14b-4664-b6ed-dae2d073824c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.706658 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-711f1df4-d14b-4664-b6ed-dae2d073824c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.707373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-711f1df4-d14b-4664-b6ed-dae2d073824c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.707823 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-711f1df4-d14b-4664-b6ed-dae2d073824c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.708271 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-711f1df4-d14b-4664-b6ed-dae2d073824c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.727738 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:39.779012 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ca3a0852-f511-40f8-926a-356ea3ce27c8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:39.779612 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ca3a0852-f511-40f8-926a-356ea3ce27c8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:39.852738 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-711f1df4-d14b-4664-b6ed-dae2d073824c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:39.862322 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-711f1df4-d14b-4664-b6ed-dae2d073824c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.168367 Sep 08 14:02:39.862910 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 187/379] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:39 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:39.867719 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d356fd58-ed97-4a47-ac64-d7a1dd20ec8b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:39.868320 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d356fd58-ed97-4a47-ac64-d7a1dd20ec8b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:39.874057 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d356fd58-ed97-4a47-ac64-d7a1dd20ec8b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.874746 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d356fd58-ed97-4a47-ac64-d7a1dd20ec8b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.875371 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d356fd58-ed97-4a47-ac64-d7a1dd20ec8b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.876656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d356fd58-ed97-4a47-ac64-d7a1dd20ec8b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.877257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d356fd58-ed97-4a47-ac64-d7a1dd20ec8b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.877839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d356fd58-ed97-4a47-ac64-d7a1dd20ec8b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.891037 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ca3a0852-f511-40f8-926a-356ea3ce27c8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:39.906570 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ca3a0852-f511-40f8-926a-356ea3ce27c8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1244 microversion: 2.1 time: 0.131420 Sep 08 14:02:39.912548 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 193/380] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:39 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1244 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:40.050339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d356fd58-ed97-4a47-ac64-d7a1dd20ec8b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:40.060083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d356fd58-ed97-4a47-ac64-d7a1dd20ec8b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1366 microversion: 2.1 time: 0.195873 Sep 08 14:02:40.060673 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 188/381] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:39 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:40.895670 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5c330aea-ea89-4e11-b935-ce7c72c9e0df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:40.897265 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5c330aea-ea89-4e11-b935-ce7c72c9e0df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:40.914093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5c330aea-ea89-4e11-b935-ce7c72c9e0df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.914093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5c330aea-ea89-4e11-b935-ce7c72c9e0df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.914093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5c330aea-ea89-4e11-b935-ce7c72c9e0df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:40.923023 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5c330aea-ea89-4e11-b935-ce7c72c9e0df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.923737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5c330aea-ea89-4e11-b935-ce7c72c9e0df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.924423 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5c330aea-ea89-4e11-b935-ce7c72c9e0df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:40.929839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-23f3d7ed-7029-4016-9dbe-43ec36a6fba1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:40.930366 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-23f3d7ed-7029-4016-9dbe-43ec36a6fba1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:40.938112 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23f3d7ed-7029-4016-9dbe-43ec36a6fba1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.942243 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23f3d7ed-7029-4016-9dbe-43ec36a6fba1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.946260 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23f3d7ed-7029-4016-9dbe-43ec36a6fba1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:40.947035 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23f3d7ed-7029-4016-9dbe-43ec36a6fba1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.947731 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23f3d7ed-7029-4016-9dbe-43ec36a6fba1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.948335 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23f3d7ed-7029-4016-9dbe-43ec36a6fba1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:41.054859 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-23f3d7ed-7029-4016-9dbe-43ec36a6fba1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:41.064631 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-23f3d7ed-7029-4016-9dbe-43ec36a6fba1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1240 microversion: 2.1 time: 0.138603 Sep 08 14:02:41.089200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 189/382] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:40 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1240 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:41.107084 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-97096340-b946-46fd-97cd-aeb237ccc194 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:41.107695 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-97096340-b946-46fd-97cd-aeb237ccc194 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:41.114689 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-97096340-b946-46fd-97cd-aeb237ccc194 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:41.115326 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-97096340-b946-46fd-97cd-aeb237ccc194 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:41.115753 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-97096340-b946-46fd-97cd-aeb237ccc194 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:41.116491 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-97096340-b946-46fd-97cd-aeb237ccc194 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:41.116939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-97096340-b946-46fd-97cd-aeb237ccc194 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:41.117351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-97096340-b946-46fd-97cd-aeb237ccc194 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:41.163258 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5c330aea-ea89-4e11-b935-ce7c72c9e0df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:41.180680 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5c330aea-ea89-4e11-b935-ce7c72c9e0df tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.291694 Sep 08 14:02:41.181736 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 194/383] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:40 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:41.331232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-97096340-b946-46fd-97cd-aeb237ccc194 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:41.347526 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-97096340-b946-46fd-97cd-aeb237ccc194 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1366 microversion: 2.1 time: 0.259276 Sep 08 14:02:41.359423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 190/384] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:41 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:42.096696 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9dbd9168-6e1d-4e3a-b737-a462dcbaf526 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:42.097458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9dbd9168-6e1d-4e3a-b737-a462dcbaf526 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:42.107375 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9dbd9168-6e1d-4e3a-b737-a462dcbaf526 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.108118 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9dbd9168-6e1d-4e3a-b737-a462dcbaf526 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.108713 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9dbd9168-6e1d-4e3a-b737-a462dcbaf526 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.109579 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9dbd9168-6e1d-4e3a-b737-a462dcbaf526 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.110186 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9dbd9168-6e1d-4e3a-b737-a462dcbaf526 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.110769 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9dbd9168-6e1d-4e3a-b737-a462dcbaf526 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.188156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9dbd9168-6e1d-4e3a-b737-a462dcbaf526 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:42.200673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9dbd9168-6e1d-4e3a-b737-a462dcbaf526 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1296 microversion: 2.1 time: 0.108453 Sep 08 14:02:42.201279 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 195/385] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:42 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:42.218878 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6c006c9d-273b-4e79-ac2b-0048e3ae3ddb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:42.222196 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6c006c9d-273b-4e79-ac2b-0048e3ae3ddb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:42.233815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c006c9d-273b-4e79-ac2b-0048e3ae3ddb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.240440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c006c9d-273b-4e79-ac2b-0048e3ae3ddb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.244929 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c006c9d-273b-4e79-ac2b-0048e3ae3ddb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.246127 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c006c9d-273b-4e79-ac2b-0048e3ae3ddb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.246614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c006c9d-273b-4e79-ac2b-0048e3ae3ddb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.247436 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c006c9d-273b-4e79-ac2b-0048e3ae3ddb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.379045 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a050757b-aa07-463f-9e42-1727c86f340f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:42.382450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a050757b-aa07-463f-9e42-1727c86f340f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:42.401960 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a050757b-aa07-463f-9e42-1727c86f340f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.401960 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a050757b-aa07-463f-9e42-1727c86f340f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.404670 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a050757b-aa07-463f-9e42-1727c86f340f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.405540 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a050757b-aa07-463f-9e42-1727c86f340f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.406157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a050757b-aa07-463f-9e42-1727c86f340f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.407341 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a050757b-aa07-463f-9e42-1727c86f340f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.602939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6c006c9d-273b-4e79-ac2b-0048e3ae3ddb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:42.624599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6c006c9d-273b-4e79-ac2b-0048e3ae3ddb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.419992 Sep 08 14:02:42.626683 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 191/386] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:42 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:42.702151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a050757b-aa07-463f-9e42-1727c86f340f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:42.745725 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a050757b-aa07-463f-9e42-1727c86f340f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1366 microversion: 2.1 time: 0.375870 Sep 08 14:02:42.752275 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 196/387] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:42 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:43.232976 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6a96b3ed-5b32-4e89-a508-7470b95083e6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:43.233804 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6a96b3ed-5b32-4e89-a508-7470b95083e6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:43.241867 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a96b3ed-5b32-4e89-a508-7470b95083e6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.242760 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a96b3ed-5b32-4e89-a508-7470b95083e6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.249614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a96b3ed-5b32-4e89-a508-7470b95083e6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.249614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a96b3ed-5b32-4e89-a508-7470b95083e6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.249614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a96b3ed-5b32-4e89-a508-7470b95083e6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.249614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a96b3ed-5b32-4e89-a508-7470b95083e6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.408501 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6a96b3ed-5b32-4e89-a508-7470b95083e6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:43.420350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6a96b3ed-5b32-4e89-a508-7470b95083e6 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1302 microversion: 2.1 time: 0.195970 Sep 08 14:02:43.430675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 192/388] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:43 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1302 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:43.672750 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-00d7ddf3-0048-4035-bf45-54a6f3b9fea6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:43.674269 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-00d7ddf3-0048-4035-bf45-54a6f3b9fea6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:43.688983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00d7ddf3-0048-4035-bf45-54a6f3b9fea6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.691954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00d7ddf3-0048-4035-bf45-54a6f3b9fea6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.693964 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00d7ddf3-0048-4035-bf45-54a6f3b9fea6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.697082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00d7ddf3-0048-4035-bf45-54a6f3b9fea6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.697761 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00d7ddf3-0048-4035-bf45-54a6f3b9fea6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.699417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00d7ddf3-0048-4035-bf45-54a6f3b9fea6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.772216 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f70ac0fc-015d-42c5-84f7-69ab33adc938 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:43.773332 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f70ac0fc-015d-42c5-84f7-69ab33adc938 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:43.794807 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f70ac0fc-015d-42c5-84f7-69ab33adc938 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.799659 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f70ac0fc-015d-42c5-84f7-69ab33adc938 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.800618 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f70ac0fc-015d-42c5-84f7-69ab33adc938 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.801813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f70ac0fc-015d-42c5-84f7-69ab33adc938 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.808252 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f70ac0fc-015d-42c5-84f7-69ab33adc938 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.809067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f70ac0fc-015d-42c5-84f7-69ab33adc938 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:44.056648 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-00d7ddf3-0048-4035-bf45-54a6f3b9fea6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:44.056648 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-00d7ddf3-0048-4035-bf45-54a6f3b9fea6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.332035 Sep 08 14:02:44.056648 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 197/389] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:43 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:44.057032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-f54b7ccf-4464-42d0-b5f7-2151b9049287 req-ad2b81c0-c37a-4d34-a073-b6f633fb62f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175ddc71-f731-4fa7-8de5-245b36c3c13b", "name": "network-vif-plugged", "status": "completed", "tag": "3f1d12fa-8092-409f-bf87-a97dd8a63d43"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:44.057032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-f54b7ccf-4464-42d0-b5f7-2151b9049287 req-ad2b81c0-c37a-4d34-a073-b6f633fb62f1 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:44.057032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-f54b7ccf-4464-42d0-b5f7-2151b9049287 req-ad2b81c0-c37a-4d34-a073-b6f633fb62f1 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:44.057032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-f54b7ccf-4464-42d0-b5f7-2151b9049287 req-ad2b81c0-c37a-4d34-a073-b6f633fb62f1 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:44.057464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-f54b7ccf-4464-42d0-b5f7-2151b9049287 req-ad2b81c0-c37a-4d34-a073-b6f633fb62f1 service nova] Creating event network-vif-plugged:3f1d12fa-8092-409f-bf87-a97dd8a63d43 for instance 175ddc71-f731-4fa7-8de5-245b36c3c13b on hv-cinder-84773 Sep 08 14:02:44.057464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-f54b7ccf-4464-42d0-b5f7-2151b9049287 req-ad2b81c0-c37a-4d34-a073-b6f633fb62f1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 Sep 08 14:02:44.057464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 198/390] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:44.057795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f70ac0fc-015d-42c5-84f7-69ab33adc938 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:44.057795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f70ac0fc-015d-42c5-84f7-69ab33adc938 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1366 microversion: 2.1 time: 0.266125 Sep 08 14:02:44.057795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 193/391] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:43 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:44.447993 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8d32ccbb-fcce-4019-a73d-99db8ab402ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:44.448747 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8d32ccbb-fcce-4019-a73d-99db8ab402ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:44.461705 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d32ccbb-fcce-4019-a73d-99db8ab402ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:44.463131 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d32ccbb-fcce-4019-a73d-99db8ab402ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:44.463750 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d32ccbb-fcce-4019-a73d-99db8ab402ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:44.466017 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d32ccbb-fcce-4019-a73d-99db8ab402ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:44.468993 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d32ccbb-fcce-4019-a73d-99db8ab402ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:44.470569 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8d32ccbb-fcce-4019-a73d-99db8ab402ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:44.970538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8d32ccbb-fcce-4019-a73d-99db8ab402ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:44.989185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8d32ccbb-fcce-4019-a73d-99db8ab402ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1370 microversion: 2.1 time: 0.544078 Sep 08 14:02:44.999568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 199/392] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:44 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1370 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:45.090144 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6e4b3518-2e22-4558-bd75-c1af5f61f7ee tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:45.098341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6e4b3518-2e22-4558-bd75-c1af5f61f7ee tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:45.098548 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-cb91b1e4-19a7-499d-9b2c-c6d7638eac63 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:45.098548 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-cb91b1e4-19a7-499d-9b2c-c6d7638eac63 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:45.101408 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb91b1e4-19a7-499d-9b2c-c6d7638eac63 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.102283 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb91b1e4-19a7-499d-9b2c-c6d7638eac63 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.103034 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb91b1e4-19a7-499d-9b2c-c6d7638eac63 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.106362 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb91b1e4-19a7-499d-9b2c-c6d7638eac63 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.107236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb91b1e4-19a7-499d-9b2c-c6d7638eac63 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.107899 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb91b1e4-19a7-499d-9b2c-c6d7638eac63 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.130378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e4b3518-2e22-4558-bd75-c1af5f61f7ee tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.136892 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e4b3518-2e22-4558-bd75-c1af5f61f7ee tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.137451 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e4b3518-2e22-4558-bd75-c1af5f61f7ee tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.138222 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e4b3518-2e22-4558-bd75-c1af5f61f7ee tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.167107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e4b3518-2e22-4558-bd75-c1af5f61f7ee tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.167859 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e4b3518-2e22-4558-bd75-c1af5f61f7ee tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.426287 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-cb91b1e4-19a7-499d-9b2c-c6d7638eac63 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:45.450414 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-cb91b1e4-19a7-499d-9b2c-c6d7638eac63 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1366 microversion: 2.1 time: 0.363707 Sep 08 14:02:45.480661 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 200/393] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:45 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:45.662931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6e4b3518-2e22-4558-bd75-c1af5f61f7ee tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:45.677278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6e4b3518-2e22-4558-bd75-c1af5f61f7ee tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1725 microversion: 2.1 time: 0.594463 Sep 08 14:02:45.677879 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 194/394] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:45 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1725 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:46.024784 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-09d2aa10-b89d-4152-8dc3-4275a8b8dbfb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:46.025667 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-09d2aa10-b89d-4152-8dc3-4275a8b8dbfb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:46.037627 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09d2aa10-b89d-4152-8dc3-4275a8b8dbfb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.038115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09d2aa10-b89d-4152-8dc3-4275a8b8dbfb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.038760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09d2aa10-b89d-4152-8dc3-4275a8b8dbfb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.039695 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09d2aa10-b89d-4152-8dc3-4275a8b8dbfb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.040312 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09d2aa10-b89d-4152-8dc3-4275a8b8dbfb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.040893 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09d2aa10-b89d-4152-8dc3-4275a8b8dbfb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.372444 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-09d2aa10-b89d-4152-8dc3-4275a8b8dbfb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:46.387801 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-09d2aa10-b89d-4152-8dc3-4275a8b8dbfb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1370 microversion: 2.1 time: 0.363684 Sep 08 14:02:46.401404 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 201/395] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:46 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:46.477683 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3ba54407-17d1-45a2-872b-5684b478da4d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:46.485794 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3ba54407-17d1-45a2-872b-5684b478da4d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:46.490748 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ba54407-17d1-45a2-872b-5684b478da4d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.492902 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ba54407-17d1-45a2-872b-5684b478da4d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.495392 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ba54407-17d1-45a2-872b-5684b478da4d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.496247 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ba54407-17d1-45a2-872b-5684b478da4d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.497654 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ba54407-17d1-45a2-872b-5684b478da4d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.499185 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3ba54407-17d1-45a2-872b-5684b478da4d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.707588 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3f62a1f0-2657-4601-87b2-03b6585dc14e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:46.708800 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3f62a1f0-2657-4601-87b2-03b6585dc14e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:46.724849 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f62a1f0-2657-4601-87b2-03b6585dc14e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.726796 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f62a1f0-2657-4601-87b2-03b6585dc14e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.727954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f62a1f0-2657-4601-87b2-03b6585dc14e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.730990 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f62a1f0-2657-4601-87b2-03b6585dc14e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.740797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f62a1f0-2657-4601-87b2-03b6585dc14e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.741498 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f62a1f0-2657-4601-87b2-03b6585dc14e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.793031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3ba54407-17d1-45a2-872b-5684b478da4d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:46.818666 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3ba54407-17d1-45a2-872b-5684b478da4d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1366 microversion: 2.1 time: 0.343513 Sep 08 14:02:46.821544 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 195/396] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:46 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:46.840986 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-c4b9924e-443f-4706-8fab-ebb75c524438 req-cdfe525d-e6a0-48d7-9fd1-7d688005044f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a905c87-01a3-4760-8c5c-7df6b9b7b190", "tag": "98ad18af-5b71-4073-a0f8-4fcd2a13191f"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:46.854074 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-c4b9924e-443f-4706-8fab-ebb75c524438 req-cdfe525d-e6a0-48d7-9fd1-7d688005044f service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.855052 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-c4b9924e-443f-4706-8fab-ebb75c524438 req-cdfe525d-e6a0-48d7-9fd1-7d688005044f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.855867 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-c4b9924e-443f-4706-8fab-ebb75c524438 req-cdfe525d-e6a0-48d7-9fd1-7d688005044f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.873593 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-c4b9924e-443f-4706-8fab-ebb75c524438 req-cdfe525d-e6a0-48d7-9fd1-7d688005044f service nova] Creating event network-changed:98ad18af-5b71-4073-a0f8-4fcd2a13191f for instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 on hv-cinder-84773 Sep 08 14:02:46.893122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-c4b9924e-443f-4706-8fab-ebb75c524438 req-cdfe525d-e6a0-48d7-9fd1-7d688005044f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068619 Sep 08 14:02:46.894405 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 196/397] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:47.070763 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3f62a1f0-2657-4601-87b2-03b6585dc14e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:47.081161 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3f62a1f0-2657-4601-87b2-03b6585dc14e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1702 microversion: 2.1 time: 0.380318 Sep 08 14:02:47.082518 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 202/398] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:46 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1702 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:47.117647 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f25c5199-152c-477e-b814-3d948eb6808d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:47.142300 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f25c5199-152c-477e-b814-3d948eb6808d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.143364 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f25c5199-152c-477e-b814-3d948eb6808d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.143810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f25c5199-152c-477e-b814-3d948eb6808d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.275330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f25c5199-152c-477e-b814-3d948eb6808d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Going to try to start instance {{(pid=133058) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 14:02:47.427470 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-18a323a3-eb13-4597-92fc-f4752cddc917 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:47.427470 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-18a323a3-eb13-4597-92fc-f4752cddc917 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:47.432490 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-18a323a3-eb13-4597-92fc-f4752cddc917 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.438130 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-18a323a3-eb13-4597-92fc-f4752cddc917 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.438861 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-18a323a3-eb13-4597-92fc-f4752cddc917 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.445408 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-18a323a3-eb13-4597-92fc-f4752cddc917 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.446680 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-18a323a3-eb13-4597-92fc-f4752cddc917 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.447711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-18a323a3-eb13-4597-92fc-f4752cddc917 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.868306 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-18a323a3-eb13-4597-92fc-f4752cddc917 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:47.879692 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-18a323a3-eb13-4597-92fc-f4752cddc917 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1370 microversion: 2.1 time: 0.469118 Sep 08 14:02:47.880283 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 203/399] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:47 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1370 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:47.888916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-568aac3d-9a97-4351-9226-d80332b1eb83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:47.889888 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-568aac3d-9a97-4351-9226-d80332b1eb83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:47.903104 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-568aac3d-9a97-4351-9226-d80332b1eb83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.905604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-568aac3d-9a97-4351-9226-d80332b1eb83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.905604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-568aac3d-9a97-4351-9226-d80332b1eb83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.905604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-568aac3d-9a97-4351-9226-d80332b1eb83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.905604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-568aac3d-9a97-4351-9226-d80332b1eb83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.906017 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-568aac3d-9a97-4351-9226-d80332b1eb83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:48.074645 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f25c5199-152c-477e-b814-3d948eb6808d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/action" status: 202 len: 0 microversion: 2.1 time: 0.963837 Sep 08 14:02:48.076103 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 197/400] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:02:47 2022] POST /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/action => generated 0 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:02:48.098858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ff01e4c7-d4ca-4c2e-b9e7-b322435bd6d6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:48.103884 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ff01e4c7-d4ca-4c2e-b9e7-b322435bd6d6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:48.126628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff01e4c7-d4ca-4c2e-b9e7-b322435bd6d6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.130586 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff01e4c7-d4ca-4c2e-b9e7-b322435bd6d6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.133700 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff01e4c7-d4ca-4c2e-b9e7-b322435bd6d6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:48.134774 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff01e4c7-d4ca-4c2e-b9e7-b322435bd6d6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.136580 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff01e4c7-d4ca-4c2e-b9e7-b322435bd6d6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.139197 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff01e4c7-d4ca-4c2e-b9e7-b322435bd6d6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:48.317409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-568aac3d-9a97-4351-9226-d80332b1eb83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:48.322033 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=100 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:48.330728 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-568aac3d-9a97-4351-9226-d80332b1eb83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1556 microversion: 2.1 time: 0.445702 Sep 08 14:02:48.343604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 204/401] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:47 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1556 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:48.382433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e434aefd-8a3f-4913-bc04-b25330c6ea16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:48.382953 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e434aefd-8a3f-4913-bc04-b25330c6ea16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:48.389162 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:48.391163 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e434aefd-8a3f-4913-bc04-b25330c6ea16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.391856 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e434aefd-8a3f-4913-bc04-b25330c6ea16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.393038 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e434aefd-8a3f-4913-bc04-b25330c6ea16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:48.393934 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e434aefd-8a3f-4913-bc04-b25330c6ea16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.394572 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e434aefd-8a3f-4913-bc04-b25330c6ea16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.395399 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e434aefd-8a3f-4913-bc04-b25330c6ea16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:48.529931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e434aefd-8a3f-4913-bc04-b25330c6ea16 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151329 Sep 08 14:02:48.530505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 205/402] 10.222.0.91 () {58 vars in 1275 bytes} [Thu Sep 8 14:02:48 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:02:48.687295 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ff01e4c7-d4ca-4c2e-b9e7-b322435bd6d6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:48.712008 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ff01e4c7-d4ca-4c2e-b9e7-b322435bd6d6 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1711 microversion: 2.1 time: 0.630533 Sep 08 14:02:48.713550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 198/403] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:48 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1711 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:48.903302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3e3fa31a-5f25-400a-a8f1-40642c6c736c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:48.903691 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3e3fa31a-5f25-400a-a8f1-40642c6c736c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:48.910784 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:48.915450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e3fa31a-5f25-400a-a8f1-40642c6c736c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.915450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e3fa31a-5f25-400a-a8f1-40642c6c736c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.915450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e3fa31a-5f25-400a-a8f1-40642c6c736c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:48.915450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e3fa31a-5f25-400a-a8f1-40642c6c736c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.916497 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e3fa31a-5f25-400a-a8f1-40642c6c736c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.916497 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e3fa31a-5f25-400a-a8f1-40642c6c736c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:49.455024 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3e3fa31a-5f25-400a-a8f1-40642c6c736c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:49.463770 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3e3fa31a-5f25-400a-a8f1-40642c6c736c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1370 microversion: 2.1 time: 0.565287 Sep 08 14:02:49.464349 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 206/404] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:48 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1370 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:49.758778 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1d0382fb-5e22-45d1-9ad3-1eb7d4b5c33f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:49.760142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1d0382fb-5e22-45d1-9ad3-1eb7d4b5c33f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:49.763002 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:49.772792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d0382fb-5e22-45d1-9ad3-1eb7d4b5c33f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:49.773711 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d0382fb-5e22-45d1-9ad3-1eb7d4b5c33f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:49.774698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d0382fb-5e22-45d1-9ad3-1eb7d4b5c33f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:49.776420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d0382fb-5e22-45d1-9ad3-1eb7d4b5c33f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:49.777049 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d0382fb-5e22-45d1-9ad3-1eb7d4b5c33f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:49.777628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1d0382fb-5e22-45d1-9ad3-1eb7d4b5c33f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:50.018632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1d0382fb-5e22-45d1-9ad3-1eb7d4b5c33f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:50.033620 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1d0382fb-5e22-45d1-9ad3-1eb7d4b5c33f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1711 microversion: 2.1 time: 0.276556 Sep 08 14:02:50.043315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 199/405] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:49 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1711 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:50.208457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-bdb38ca5-c2fa-4627-851b-3a5d3606b321 req-1fcd4559-0fe4-47a5-ba25-1234c792bc44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "175ddc71-f731-4fa7-8de5-245b36c3c13b", "tag": "3f1d12fa-8092-409f-bf87-a97dd8a63d43"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:50.217456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=18 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:50.220470 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-bdb38ca5-c2fa-4627-851b-3a5d3606b321 req-1fcd4559-0fe4-47a5-ba25-1234c792bc44 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:50.221619 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-bdb38ca5-c2fa-4627-851b-3a5d3606b321 req-1fcd4559-0fe4-47a5-ba25-1234c792bc44 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:50.222243 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-bdb38ca5-c2fa-4627-851b-3a5d3606b321 req-1fcd4559-0fe4-47a5-ba25-1234c792bc44 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:50.265341 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-bdb38ca5-c2fa-4627-851b-3a5d3606b321 req-1fcd4559-0fe4-47a5-ba25-1234c792bc44 service nova] Creating event network-changed:3f1d12fa-8092-409f-bf87-a97dd8a63d43 for instance 175ddc71-f731-4fa7-8de5-245b36c3c13b on hv-cinder-84773 Sep 08 14:02:50.284636 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-bdb38ca5-c2fa-4627-851b-3a5d3606b321 req-1fcd4559-0fe4-47a5-ba25-1234c792bc44 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079362 Sep 08 14:02:50.285616 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 207/406] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:50.489107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-90a7bd99-6cf1-4808-9004-0ed07c0b9983 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:50.490275 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-90a7bd99-6cf1-4808-9004-0ed07c0b9983 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:50.496653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:50.498769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90a7bd99-6cf1-4808-9004-0ed07c0b9983 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:50.499574 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90a7bd99-6cf1-4808-9004-0ed07c0b9983 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:50.500182 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90a7bd99-6cf1-4808-9004-0ed07c0b9983 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:50.501216 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90a7bd99-6cf1-4808-9004-0ed07c0b9983 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:50.501892 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90a7bd99-6cf1-4808-9004-0ed07c0b9983 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:50.502570 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-90a7bd99-6cf1-4808-9004-0ed07c0b9983 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:50.772013 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-90a7bd99-6cf1-4808-9004-0ed07c0b9983 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:50.782453 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-90a7bd99-6cf1-4808-9004-0ed07c0b9983 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1370 microversion: 2.1 time: 0.298396 Sep 08 14:02:50.784125 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 200/407] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:50 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:51.056320 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-cc2aa3ec-2d89-44ac-8f3e-b6fdf7eae686 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:51.057663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-cc2aa3ec-2d89-44ac-8f3e-b6fdf7eae686 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:51.073955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cc2aa3ec-2d89-44ac-8f3e-b6fdf7eae686 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:51.079011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cc2aa3ec-2d89-44ac-8f3e-b6fdf7eae686 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:51.084740 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cc2aa3ec-2d89-44ac-8f3e-b6fdf7eae686 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:51.085608 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cc2aa3ec-2d89-44ac-8f3e-b6fdf7eae686 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:51.086156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cc2aa3ec-2d89-44ac-8f3e-b6fdf7eae686 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:51.086654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cc2aa3ec-2d89-44ac-8f3e-b6fdf7eae686 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:51.325930 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-cc2aa3ec-2d89-44ac-8f3e-b6fdf7eae686 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:51.336466 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-cc2aa3ec-2d89-44ac-8f3e-b6fdf7eae686 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1711 microversion: 2.1 time: 0.285424 Sep 08 14:02:51.337873 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 208/408] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:51 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1711 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:51.811183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e2967d27-e577-473f-93bf-3460bba331e1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:51.812751 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e2967d27-e577-473f-93bf-3460bba331e1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:51.831219 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2967d27-e577-473f-93bf-3460bba331e1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:51.832048 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2967d27-e577-473f-93bf-3460bba331e1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:51.833537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2967d27-e577-473f-93bf-3460bba331e1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:51.834602 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2967d27-e577-473f-93bf-3460bba331e1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:51.835235 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2967d27-e577-473f-93bf-3460bba331e1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:51.837051 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2967d27-e577-473f-93bf-3460bba331e1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:52.166562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e2967d27-e577-473f-93bf-3460bba331e1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:52.166562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e2967d27-e577-473f-93bf-3460bba331e1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1370 microversion: 2.1 time: 0.284943 Sep 08 14:02:52.166562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 201/409] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:51 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1370 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:52.362040 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-19933ba6-dc61-427b-842d-a84a002e27d5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:52.362808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-19933ba6-dc61-427b-842d-a84a002e27d5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:52.370106 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-19933ba6-dc61-427b-842d-a84a002e27d5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:52.370751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-19933ba6-dc61-427b-842d-a84a002e27d5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:52.371514 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-19933ba6-dc61-427b-842d-a84a002e27d5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:52.372515 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-19933ba6-dc61-427b-842d-a84a002e27d5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:52.373225 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-19933ba6-dc61-427b-842d-a84a002e27d5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:52.373800 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-19933ba6-dc61-427b-842d-a84a002e27d5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:52.523289 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-19933ba6-dc61-427b-842d-a84a002e27d5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:52.533658 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-19933ba6-dc61-427b-842d-a84a002e27d5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1711 microversion: 2.1 time: 0.175604 Sep 08 14:02:52.534330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 209/410] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:52 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1711 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:53.146839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6afcc903-42a8-40f6-aadd-b2619aff1de2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:53.148330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6afcc903-42a8-40f6-aadd-b2619aff1de2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:53.158559 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6afcc903-42a8-40f6-aadd-b2619aff1de2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:53.159904 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6afcc903-42a8-40f6-aadd-b2619aff1de2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:53.160394 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6afcc903-42a8-40f6-aadd-b2619aff1de2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:53.167206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6afcc903-42a8-40f6-aadd-b2619aff1de2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:53.167206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6afcc903-42a8-40f6-aadd-b2619aff1de2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:53.167206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6afcc903-42a8-40f6-aadd-b2619aff1de2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:53.319509 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6afcc903-42a8-40f6-aadd-b2619aff1de2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:53.335127 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6afcc903-42a8-40f6-aadd-b2619aff1de2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1370 microversion: 2.1 time: 0.193251 Sep 08 14:02:53.336363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 202/411] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:53 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:53.557443 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ee867bbf-fae7-4141-8b38-d45927a9ea8c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:53.559506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ee867bbf-fae7-4141-8b38-d45927a9ea8c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:53.567766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee867bbf-fae7-4141-8b38-d45927a9ea8c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:53.568933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee867bbf-fae7-4141-8b38-d45927a9ea8c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:53.569869 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee867bbf-fae7-4141-8b38-d45927a9ea8c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:53.570989 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee867bbf-fae7-4141-8b38-d45927a9ea8c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:53.571838 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee867bbf-fae7-4141-8b38-d45927a9ea8c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:53.572526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ee867bbf-fae7-4141-8b38-d45927a9ea8c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:53.684684 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-53b04903-b53d-4da8-863a-da04cb6d3906 req-72de5846-01df-4320-96d0-c8300ab7bc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a905c87-01a3-4760-8c5c-7df6b9b7b190", "name": "network-vif-plugged", "status": "completed", "tag": "98ad18af-5b71-4073-a0f8-4fcd2a13191f"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:53.703426 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-53b04903-b53d-4da8-863a-da04cb6d3906 req-72de5846-01df-4320-96d0-c8300ab7bc67 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:53.703916 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-53b04903-b53d-4da8-863a-da04cb6d3906 req-72de5846-01df-4320-96d0-c8300ab7bc67 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:53.704465 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-53b04903-b53d-4da8-863a-da04cb6d3906 req-72de5846-01df-4320-96d0-c8300ab7bc67 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:53.728533 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-53b04903-b53d-4da8-863a-da04cb6d3906 req-72de5846-01df-4320-96d0-c8300ab7bc67 service nova] Creating event network-vif-plugged:98ad18af-5b71-4073-a0f8-4fcd2a13191f for instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 on hv-cinder-84773 Sep 08 14:02:53.734390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-53b04903-b53d-4da8-863a-da04cb6d3906 req-72de5846-01df-4320-96d0-c8300ab7bc67 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053753 Sep 08 14:02:53.741853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 203/412] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:53.781092 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ee867bbf-fae7-4141-8b38-d45927a9ea8c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:53.791897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ee867bbf-fae7-4141-8b38-d45927a9ea8c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1715 microversion: 2.1 time: 0.237128 Sep 08 14:02:53.793483 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 210/413] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:53 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1715 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:54.363653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9c18ec27-edbd-49d0-b712-1d52580232c7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:54.364359 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9c18ec27-edbd-49d0-b712-1d52580232c7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:54.374958 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c18ec27-edbd-49d0-b712-1d52580232c7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:54.375462 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c18ec27-edbd-49d0-b712-1d52580232c7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:54.375900 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c18ec27-edbd-49d0-b712-1d52580232c7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:54.376661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c18ec27-edbd-49d0-b712-1d52580232c7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:54.377115 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c18ec27-edbd-49d0-b712-1d52580232c7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:54.377535 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9c18ec27-edbd-49d0-b712-1d52580232c7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:54.402872 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:54.563590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9c18ec27-edbd-49d0-b712-1d52580232c7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:54.574075 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9c18ec27-edbd-49d0-b712-1d52580232c7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1370 microversion: 2.1 time: 0.215730 Sep 08 14:02:54.575561 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 204/414] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:54 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:55.607616 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-023f1fce-8b7f-4d64-97c6-7dcdfbd696f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:55.608342 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-023f1fce-8b7f-4d64-97c6-7dcdfbd696f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:55.615423 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-023f1fce-8b7f-4d64-97c6-7dcdfbd696f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:55.615908 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-023f1fce-8b7f-4d64-97c6-7dcdfbd696f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:55.616339 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-023f1fce-8b7f-4d64-97c6-7dcdfbd696f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:55.617027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-023f1fce-8b7f-4d64-97c6-7dcdfbd696f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:55.617479 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-023f1fce-8b7f-4d64-97c6-7dcdfbd696f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:55.617898 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-023f1fce-8b7f-4d64-97c6-7dcdfbd696f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:55.777916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-023f1fce-8b7f-4d64-97c6-7dcdfbd696f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:55.786429 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-023f1fce-8b7f-4d64-97c6-7dcdfbd696f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1370 microversion: 2.1 time: 0.182606 Sep 08 14:02:55.787044 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 211/415] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:55 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:56.809779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2b09f4eb-c13b-47de-837e-fb4ff7f8eaed tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:56.810356 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2b09f4eb-c13b-47de-837e-fb4ff7f8eaed tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:56.817291 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b09f4eb-c13b-47de-837e-fb4ff7f8eaed tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:56.817769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b09f4eb-c13b-47de-837e-fb4ff7f8eaed tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:56.818323 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b09f4eb-c13b-47de-837e-fb4ff7f8eaed tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:56.819280 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b09f4eb-c13b-47de-837e-fb4ff7f8eaed tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:56.819724 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b09f4eb-c13b-47de-837e-fb4ff7f8eaed tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:56.823657 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b09f4eb-c13b-47de-837e-fb4ff7f8eaed tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:56.958078 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2b09f4eb-c13b-47de-837e-fb4ff7f8eaed tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:56.965555 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2b09f4eb-c13b-47de-837e-fb4ff7f8eaed tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1564 microversion: 2.1 time: 0.159745 Sep 08 14:02:56.966121 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 205/416] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:56 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:56.988446 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-907de81f-001f-4a52-ab95-35f976260a23 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:56.988983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-907de81f-001f-4a52-ab95-35f976260a23 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:56.995664 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-907de81f-001f-4a52-ab95-35f976260a23 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:56.996181 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-907de81f-001f-4a52-ab95-35f976260a23 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:56.996605 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-907de81f-001f-4a52-ab95-35f976260a23 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:56.997291 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-907de81f-001f-4a52-ab95-35f976260a23 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:56.997736 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-907de81f-001f-4a52-ab95-35f976260a23 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:56.998151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-907de81f-001f-4a52-ab95-35f976260a23 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:57.079613 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-907de81f-001f-4a52-ab95-35f976260a23 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095519 Sep 08 14:02:57.080264 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 212/417] 10.222.0.91 () {58 vars in 1275 bytes} [Thu Sep 8 14:02:56 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:57.294819 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fac6918b-28cc-4bd1-a529-90516b9e46fc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Action: 'create', calling method: .version_select at 0x7f520003ec10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1806648975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBsCTonpos2yQMZf+mnvhjrL7dY9ZzNR/71vzZWFtMy/27gh8gQFNx7wpYoJSAhfezoYvs9Y9U0fLXJbaVA5riHOnkiiC6kB/NeRNQ/Yp358ndi6WPH3nRM7C7GbFB0Cw=="}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:57.312170 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-fac6918b-28cc-4bd1-a529-90516b9e46fc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Getting quotas for project c533fdd2bf51465792fc266cefeb58f7. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:57.317459 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-fac6918b-28cc-4bd1-a529-90516b9e46fc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Getting quotas for user 29c2921e57dc44d2b6d334e88baae0cd and project c533fdd2bf51465792fc266cefeb58f7. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:57.457193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-fac6918b-28cc-4bd1-a529-90516b9e46fc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.166360 Sep 08 14:02:57.457812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 206/418] 10.222.0.91 () {60 vars in 1159 bytes} [Thu Sep 8 14:02:57 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:02:57.578408 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-963837638", "imageRef": "a4dd2834-99a1-4f99-b1aa-222bed869010", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1806648975", "networks": [{"uuid": "46db4f7a-bc33-494b-8928-b28915966e7e"}]}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:57.634757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] validate_networks() for [('46db4f7a-bc33-494b-8928-b28915966e7e', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:02:58.336867 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:02:58.337518 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:02:58.337938 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:02:58.338462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:02:58.338952 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:02:58.348479 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:58.350328 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:58.350328 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:58.350328 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:58.351323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:58.351323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:58.368846 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Getting quotas for project c533fdd2bf51465792fc266cefeb58f7. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:58.373172 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Getting quotas for user 29c2921e57dc44d2b6d334e88baae0cd and project c533fdd2bf51465792fc266cefeb58f7. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:58.385332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:02:58.387604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4dd2834-99a1-4f99-b1aa-222bed869010',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:02:58.450924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-325d89b5-1505-4638-9336-f2ed1097acb5 req-d5e90295-10e6-4aa3-a9ba-953a1a9ffcfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a905c87-01a3-4760-8c5c-7df6b9b7b190", "tag": "98ad18af-5b71-4073-a0f8-4fcd2a13191f"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:58.461768 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-325d89b5-1505-4638-9336-f2ed1097acb5 req-d5e90295-10e6-4aa3-a9ba-953a1a9ffcfc service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:58.462240 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-325d89b5-1505-4638-9336-f2ed1097acb5 req-d5e90295-10e6-4aa3-a9ba-953a1a9ffcfc service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:58.462664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-325d89b5-1505-4638-9336-f2ed1097acb5 req-d5e90295-10e6-4aa3-a9ba-953a1a9ffcfc service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:58.474915 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-325d89b5-1505-4638-9336-f2ed1097acb5 req-d5e90295-10e6-4aa3-a9ba-953a1a9ffcfc service nova] Creating event network-changed:98ad18af-5b71-4073-a0f8-4fcd2a13191f for instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 on hv-cinder-84773 Sep 08 14:02:58.488350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-325d89b5-1505-4638-9336-f2ed1097acb5 req-d5e90295-10e6-4aa3-a9ba-953a1a9ffcfc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035060 Sep 08 14:02:58.488350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 207/419] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:02:58.571912 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d20a14ff-e88f-4798-b68c-b7e861cf1f7a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.998683 Sep 08 14:02:58.573326 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 213/420] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:02:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:02:58.593586 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-816472be-32d5-4a6d-8e44-0c039903479c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:58.595350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-816472be-32d5-4a6d-8e44-0c039903479c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:58.717917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-816472be-32d5-4a6d-8e44-0c039903479c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:58.727662 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-816472be-32d5-4a6d-8e44-0c039903479c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1258 microversion: 2.1 time: 0.141460 Sep 08 14:02:58.728878 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 208/421] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:58 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1258 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:59.766660 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-bf8f1175-c886-427c-8b70-841059c8c568 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:59.768054 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-bf8f1175-c886-427c-8b70-841059c8c568 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:59.838046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-bf8f1175-c886-427c-8b70-841059c8c568 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:59.847185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-bf8f1175-c886-427c-8b70-841059c8c568 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1258 microversion: 2.1 time: 0.084856 Sep 08 14:02:59.847593 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 214/422] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:59 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:00.870203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-019489d6-1e92-4db2-abd4-ec4122f1610e tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:00.873545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-019489d6-1e92-4db2-abd4-ec4122f1610e tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:00.878494 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-019489d6-1e92-4db2-abd4-ec4122f1610e tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:00.879009 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-019489d6-1e92-4db2-abd4-ec4122f1610e tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:00.879446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-019489d6-1e92-4db2-abd4-ec4122f1610e tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:00.880137 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-019489d6-1e92-4db2-abd4-ec4122f1610e tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:00.880591 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-019489d6-1e92-4db2-abd4-ec4122f1610e tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:00.881029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-019489d6-1e92-4db2-abd4-ec4122f1610e tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:00.949889 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-019489d6-1e92-4db2-abd4-ec4122f1610e tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:00.958047 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-019489d6-1e92-4db2-abd4-ec4122f1610e tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1254 microversion: 2.1 time: 0.091624 Sep 08 14:03:00.958621 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 209/423] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:00 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1254 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:01.984787 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-30c36105-7664-475c-91cd-329099935094 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:01.985618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-30c36105-7664-475c-91cd-329099935094 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:01.993262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-30c36105-7664-475c-91cd-329099935094 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:01.993740 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-30c36105-7664-475c-91cd-329099935094 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:01.994222 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-30c36105-7664-475c-91cd-329099935094 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:01.994881 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-30c36105-7664-475c-91cd-329099935094 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:01.995351 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-30c36105-7664-475c-91cd-329099935094 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:01.995772 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-30c36105-7664-475c-91cd-329099935094 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:02.062092 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-30c36105-7664-475c-91cd-329099935094 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:02.069826 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-30c36105-7664-475c-91cd-329099935094 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1310 microversion: 2.1 time: 0.089043 Sep 08 14:03:02.070414 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 215/424] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:01 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:03.092651 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fc9a2278-56bf-4ae2-b115-db5a9285908c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:03.093573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-fc9a2278-56bf-4ae2-b115-db5a9285908c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:03.100542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc9a2278-56bf-4ae2-b115-db5a9285908c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.101037 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc9a2278-56bf-4ae2-b115-db5a9285908c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.101480 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc9a2278-56bf-4ae2-b115-db5a9285908c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.102179 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc9a2278-56bf-4ae2-b115-db5a9285908c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.102634 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc9a2278-56bf-4ae2-b115-db5a9285908c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.103101 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc9a2278-56bf-4ae2-b115-db5a9285908c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.103252 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-242a46a8-9bfc-4c5d-80d2-daabfcdd8eb4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:03.104185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-242a46a8-9bfc-4c5d-80d2-daabfcdd8eb4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:03.111607 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-242a46a8-9bfc-4c5d-80d2-daabfcdd8eb4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.112089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-242a46a8-9bfc-4c5d-80d2-daabfcdd8eb4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.112540 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-242a46a8-9bfc-4c5d-80d2-daabfcdd8eb4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.113245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-242a46a8-9bfc-4c5d-80d2-daabfcdd8eb4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.113697 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-242a46a8-9bfc-4c5d-80d2-daabfcdd8eb4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.114121 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-242a46a8-9bfc-4c5d-80d2-daabfcdd8eb4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.146614 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-242a46a8-9bfc-4c5d-80d2-daabfcdd8eb4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/ips" status: 200 len: 151 microversion: 2.20 time: 0.048035 Sep 08 14:03:03.155250 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 216/425] 10.222.0.91 () {60 vars in 1289 bytes} [Thu Sep 8 14:03:03 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:03:03.371285 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-fc9a2278-56bf-4ae2-b115-db5a9285908c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:03.383313 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-fc9a2278-56bf-4ae2-b115-db5a9285908c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.295102 Sep 08 14:03:03.384204 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 210/426] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:03 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:04.409526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-479e6b80-1f83-4120-8abf-55b0b0587d24 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:04.411512 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-479e6b80-1f83-4120-8abf-55b0b0587d24 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:04.418660 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-479e6b80-1f83-4120-8abf-55b0b0587d24 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:04.419415 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-479e6b80-1f83-4120-8abf-55b0b0587d24 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:04.419943 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-479e6b80-1f83-4120-8abf-55b0b0587d24 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:04.420684 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-479e6b80-1f83-4120-8abf-55b0b0587d24 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:04.421374 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-479e6b80-1f83-4120-8abf-55b0b0587d24 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:04.421964 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-479e6b80-1f83-4120-8abf-55b0b0587d24 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:04.583276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-479e6b80-1f83-4120-8abf-55b0b0587d24 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:04.592956 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-479e6b80-1f83-4120-8abf-55b0b0587d24 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.188568 Sep 08 14:03:04.593958 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 217/427] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:04 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:05.616781 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0bb03214-e3d7-4ffa-a7c2-401dd76b1332 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:05.617448 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0bb03214-e3d7-4ffa-a7c2-401dd76b1332 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:05.623781 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0bb03214-e3d7-4ffa-a7c2-401dd76b1332 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.624249 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0bb03214-e3d7-4ffa-a7c2-401dd76b1332 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.624677 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0bb03214-e3d7-4ffa-a7c2-401dd76b1332 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:05.625356 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0bb03214-e3d7-4ffa-a7c2-401dd76b1332 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.625793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0bb03214-e3d7-4ffa-a7c2-401dd76b1332 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.626207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0bb03214-e3d7-4ffa-a7c2-401dd76b1332 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:05.772051 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0bb03214-e3d7-4ffa-a7c2-401dd76b1332 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:05.779899 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0bb03214-e3d7-4ffa-a7c2-401dd76b1332 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.167005 Sep 08 14:03:05.780451 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 211/428] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:05 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:06.359586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f2852040-a571-481a-ad19-72e7d360b114 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:06.360164 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f2852040-a571-481a-ad19-72e7d360b114 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:06.367544 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f2852040-a571-481a-ad19-72e7d360b114 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:06.368027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f2852040-a571-481a-ad19-72e7d360b114 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:06.368456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f2852040-a571-481a-ad19-72e7d360b114 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:06.369152 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f2852040-a571-481a-ad19-72e7d360b114 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:06.369600 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f2852040-a571-481a-ad19-72e7d360b114 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:06.370034 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f2852040-a571-481a-ad19-72e7d360b114 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:06.395930 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-f2852040-a571-481a-ad19-72e7d360b114 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lazy-loading 'flavor' on Instance uuid 99ba16ca-2c31-48e8-853e-416c2c3bf1fd {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:06.803961 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6bac59c0-f6bb-4c7d-b9fe-6babe7c0602b tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:06.821796 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6bac59c0-f6bb-4c7d-b9fe-6babe7c0602b tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:06.821796 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6bac59c0-f6bb-4c7d-b9fe-6babe7c0602b tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:06.821796 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6bac59c0-f6bb-4c7d-b9fe-6babe7c0602b tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:06.821796 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6bac59c0-f6bb-4c7d-b9fe-6babe7c0602b tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:06.823120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6bac59c0-f6bb-4c7d-b9fe-6babe7c0602b tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:06.823120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6bac59c0-f6bb-4c7d-b9fe-6babe7c0602b tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:06.823120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6bac59c0-f6bb-4c7d-b9fe-6babe7c0602b tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:06.995429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6bac59c0-f6bb-4c7d-b9fe-6babe7c0602b tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:07.004042 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6bac59c0-f6bb-4c7d-b9fe-6babe7c0602b tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.204486 Sep 08 14:03:07.004996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 212/429] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:06 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:07.497249 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f2852040-a571-481a-ad19-72e7d360b114 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "POST /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/action" status: 202 len: 0 microversion: 2.20 time: 1.141560 Sep 08 14:03:07.507522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:07.509912 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:07.510050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 218/430] 10.222.0.91 () {62 vars in 1319 bytes} [Thu Sep 8 14:03:06 2022] POST /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/action => generated 0 bytes in 1154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:03:07.515305 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.515955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.516470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.517341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.517876 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.518396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.672231 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:07.683912 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:07.685853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:07.687447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9364c6ad-3b64-43a6-8c88-ce8fb061c57f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.184403 Sep 08 14:03:07.688289 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 213/431] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:07 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:03:08.029638 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-81f54b0c-960b-49c8-bdea-94850b6a03fb tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:08.030266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-81f54b0c-960b-49c8-bdea-94850b6a03fb tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:08.037867 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81f54b0c-960b-49c8-bdea-94850b6a03fb tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.038354 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81f54b0c-960b-49c8-bdea-94850b6a03fb tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.038791 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81f54b0c-960b-49c8-bdea-94850b6a03fb tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.039522 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81f54b0c-960b-49c8-bdea-94850b6a03fb tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.039978 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81f54b0c-960b-49c8-bdea-94850b6a03fb tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.040431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81f54b0c-960b-49c8-bdea-94850b6a03fb tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.183304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-81f54b0c-960b-49c8-bdea-94850b6a03fb tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:08.193528 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-81f54b0c-960b-49c8-bdea-94850b6a03fb tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.168462 Sep 08 14:03:08.194169 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 219/432] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:08 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:08.716758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:08.718441 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:08.726521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=6 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:08.729087 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.729582 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.730457 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.730720 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.731198 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.731611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.875162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:08.884361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:08.885811 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:08.887013 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1f515a01-aa2e-4e84-bd88-5e538c679b10 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.175327 Sep 08 14:03:08.887588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 214/433] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:08 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:09.220195 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0864a90a-402b-4c3f-a22c-707afbcd6985 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:09.221819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0864a90a-402b-4c3f-a22c-707afbcd6985 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:09.224209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:09.231972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0864a90a-402b-4c3f-a22c-707afbcd6985 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.232472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0864a90a-402b-4c3f-a22c-707afbcd6985 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.232911 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0864a90a-402b-4c3f-a22c-707afbcd6985 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:09.233630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0864a90a-402b-4c3f-a22c-707afbcd6985 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.234083 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0864a90a-402b-4c3f-a22c-707afbcd6985 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.234510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0864a90a-402b-4c3f-a22c-707afbcd6985 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:09.395808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0864a90a-402b-4c3f-a22c-707afbcd6985 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:09.405241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0864a90a-402b-4c3f-a22c-707afbcd6985 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.190954 Sep 08 14:03:09.405956 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 220/434] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:09 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:09.913828 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:09.914499 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:09.921488 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.921979 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.922446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:09.923704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.924161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.924591 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:10.088580 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:10.097895 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:10.099578 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:10.100866 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9eeb4ed5-c63f-4a74-8038-4f1a69b9ad0d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.191112 Sep 08 14:03:10.101629 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 215/435] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:09 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:03:10.429568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5d6d9e51-be3e-411c-b093-5cc7b52fc374 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:10.430254 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5d6d9e51-be3e-411c-b093-5cc7b52fc374 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:10.432079 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=8 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:10.437240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5d6d9e51-be3e-411c-b093-5cc7b52fc374 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:10.437757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5d6d9e51-be3e-411c-b093-5cc7b52fc374 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:10.438188 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5d6d9e51-be3e-411c-b093-5cc7b52fc374 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:10.439557 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5d6d9e51-be3e-411c-b093-5cc7b52fc374 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:10.440082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5d6d9e51-be3e-411c-b093-5cc7b52fc374 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:10.440424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5d6d9e51-be3e-411c-b093-5cc7b52fc374 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:10.580785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5d6d9e51-be3e-411c-b093-5cc7b52fc374 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:10.591307 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5d6d9e51-be3e-411c-b093-5cc7b52fc374 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.165046 Sep 08 14:03:10.593076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 221/436] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:10 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:11.127216 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:11.130766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:11.134708 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.135254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.135697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.136379 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.136834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.137257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.299431 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:11.309686 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:11.311410 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:11.312634 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-31d93cdb-a062-4de8-b614-587d0cb66e05 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.189433 Sep 08 14:03:11.313676 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 216/437] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:11 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:11.684482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b67f7632-6f56-4e14-bd35-9cc222a7de38 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:11.698048 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b67f7632-6f56-4e14-bd35-9cc222a7de38 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:11.698048 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b67f7632-6f56-4e14-bd35-9cc222a7de38 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.698048 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b67f7632-6f56-4e14-bd35-9cc222a7de38 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.698048 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b67f7632-6f56-4e14-bd35-9cc222a7de38 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.698443 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b67f7632-6f56-4e14-bd35-9cc222a7de38 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.698443 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b67f7632-6f56-4e14-bd35-9cc222a7de38 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.698443 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b67f7632-6f56-4e14-bd35-9cc222a7de38 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.877580 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b67f7632-6f56-4e14-bd35-9cc222a7de38 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:11.880993 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:11.888550 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b67f7632-6f56-4e14-bd35-9cc222a7de38 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.208510 Sep 08 14:03:11.889129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 222/438] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:11 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:12.350347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:12.351142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:12.357288 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.357760 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.358185 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.358857 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.359325 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.359736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.502455 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:12.515762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:12.518520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:12.526613 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e74d7fa6-72fc-48fe-b5ea-43bfc7998415 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.173756 Sep 08 14:03:12.528726 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 217/439] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:12 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:12.914366 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ad2c5bfa-0538-4fa3-82cb-0b4bd1449dac tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:12.915272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ad2c5bfa-0538-4fa3-82cb-0b4bd1449dac tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:12.924176 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad2c5bfa-0538-4fa3-82cb-0b4bd1449dac tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.924662 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad2c5bfa-0538-4fa3-82cb-0b4bd1449dac tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.925090 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad2c5bfa-0538-4fa3-82cb-0b4bd1449dac tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.925784 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad2c5bfa-0538-4fa3-82cb-0b4bd1449dac tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.926233 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad2c5bfa-0538-4fa3-82cb-0b4bd1449dac tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.926675 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad2c5bfa-0538-4fa3-82cb-0b4bd1449dac tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.066005 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ad2c5bfa-0538-4fa3-82cb-0b4bd1449dac tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:13.078482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ad2c5bfa-0538-4fa3-82cb-0b4bd1449dac tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.168989 Sep 08 14:03:13.079643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 223/440] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:12 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:13.560396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:13.565133 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:13.576351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.577345 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.578074 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.580288 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.581021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.581448 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.733705 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:13.744592 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:13.746351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:13.747651 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-75c0a232-2271-40bc-baf2-3e1bfd9b90d8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.194255 Sep 08 14:03:13.763134 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 218/441] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:13 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:14.117540 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-26505c93-008c-4b40-a2d1-d09d5b8496b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:14.118268 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-26505c93-008c-4b40-a2d1-d09d5b8496b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:14.124643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26505c93-008c-4b40-a2d1-d09d5b8496b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.125115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26505c93-008c-4b40-a2d1-d09d5b8496b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.125543 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26505c93-008c-4b40-a2d1-d09d5b8496b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.126845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26505c93-008c-4b40-a2d1-d09d5b8496b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.127316 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26505c93-008c-4b40-a2d1-d09d5b8496b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.127734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26505c93-008c-4b40-a2d1-d09d5b8496b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.257864 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-26505c93-008c-4b40-a2d1-d09d5b8496b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:14.266165 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-26505c93-008c-4b40-a2d1-d09d5b8496b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.152448 Sep 08 14:03:14.266731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 224/442] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:14 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:14.779468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:14.780096 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:14.787178 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.787664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.788095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.788793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.789241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.789659 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.935948 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:14.944239 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:14.945723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:14.946917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f0fa458f-a62f-4998-adc1-d8ef3a366a77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.171628 Sep 08 14:03:14.947474 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 219/443] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:14 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:15.291156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b4d575d4-02a2-42e6-bac4-d3c0b1b5d865 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:15.291764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b4d575d4-02a2-42e6-bac4-d3c0b1b5d865 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:15.298246 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4d575d4-02a2-42e6-bac4-d3c0b1b5d865 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.298731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4d575d4-02a2-42e6-bac4-d3c0b1b5d865 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.299202 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4d575d4-02a2-42e6-bac4-d3c0b1b5d865 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.299900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4d575d4-02a2-42e6-bac4-d3c0b1b5d865 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.300351 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4d575d4-02a2-42e6-bac4-d3c0b1b5d865 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.300769 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b4d575d4-02a2-42e6-bac4-d3c0b1b5d865 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.436452 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b4d575d4-02a2-42e6-bac4-d3c0b1b5d865 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:15.444761 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b4d575d4-02a2-42e6-bac4-d3c0b1b5d865 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.158300 Sep 08 14:03:15.445330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 225/444] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:15 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:15.974115 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:15.974740 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:15.981402 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.981884 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.982310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.983110 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.983563 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.983975 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.223165 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:16.231608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:16.233187 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:16.234351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e57f8ec1-9390-41fd-8347-21b5d012dd9a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.265007 Sep 08 14:03:16.234926 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 220/445] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:15 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:16.470442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7452d1bc-3e8f-429d-8308-48d98379a981 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:16.471492 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7452d1bc-3e8f-429d-8308-48d98379a981 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:16.478798 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7452d1bc-3e8f-429d-8308-48d98379a981 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.484263 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7452d1bc-3e8f-429d-8308-48d98379a981 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.484263 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7452d1bc-3e8f-429d-8308-48d98379a981 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.484263 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7452d1bc-3e8f-429d-8308-48d98379a981 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.484263 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7452d1bc-3e8f-429d-8308-48d98379a981 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.484636 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7452d1bc-3e8f-429d-8308-48d98379a981 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.630075 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7452d1bc-3e8f-429d-8308-48d98379a981 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:16.638425 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7452d1bc-3e8f-429d-8308-48d98379a981 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.173372 Sep 08 14:03:16.639063 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 226/446] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:16 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:16.859409 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-45016732-3b04-4fa7-a4d1-c8e076d96feb req-0d3229b8-7ba7-4a2d-aee7-e4ea73fad2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe93656-bec8-4094-9b98-062302018a59", "tag": "8d168477-404b-4ddb-8747-6423a9c84ab9"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:16.877421 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-45016732-3b04-4fa7-a4d1-c8e076d96feb req-0d3229b8-7ba7-4a2d-aee7-e4ea73fad2a4 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.884530 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-45016732-3b04-4fa7-a4d1-c8e076d96feb req-0d3229b8-7ba7-4a2d-aee7-e4ea73fad2a4 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.884530 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-45016732-3b04-4fa7-a4d1-c8e076d96feb req-0d3229b8-7ba7-4a2d-aee7-e4ea73fad2a4 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.900014 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-45016732-3b04-4fa7-a4d1-c8e076d96feb req-0d3229b8-7ba7-4a2d-aee7-e4ea73fad2a4 service nova] Creating event network-changed:8d168477-404b-4ddb-8747-6423a9c84ab9 for instance 5fe93656-bec8-4094-9b98-062302018a59 on hv-cinder-84773 Sep 08 14:03:16.908664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-45016732-3b04-4fa7-a4d1-c8e076d96feb req-0d3229b8-7ba7-4a2d-aee7-e4ea73fad2a4 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055553 Sep 08 14:03:16.909694 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 221/447] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:17.260004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:17.260635 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:17.267263 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.267680 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.268114 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.268819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.269279 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.270067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.406033 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:17.414359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:17.415817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:17.416960 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-60b23d07-494b-4970-9503-ee650f9028e7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.160851 Sep 08 14:03:17.417516 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 227/448] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:17 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:03:17.663089 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0f95cf83-3b6f-4330-ab29-51a6f518c8c8 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:17.663773 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0f95cf83-3b6f-4330-ab29-51a6f518c8c8 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:17.670007 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f95cf83-3b6f-4330-ab29-51a6f518c8c8 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.670487 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f95cf83-3b6f-4330-ab29-51a6f518c8c8 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.670962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f95cf83-3b6f-4330-ab29-51a6f518c8c8 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.671655 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f95cf83-3b6f-4330-ab29-51a6f518c8c8 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.672104 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f95cf83-3b6f-4330-ab29-51a6f518c8c8 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.672521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f95cf83-3b6f-4330-ab29-51a6f518c8c8 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.820145 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0f95cf83-3b6f-4330-ab29-51a6f518c8c8 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:17.828442 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0f95cf83-3b6f-4330-ab29-51a6f518c8c8 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.170126 Sep 08 14:03:17.829060 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 222/449] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:17 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:18.442258 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:18.442874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:18.449401 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.449881 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.450314 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.451026 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.451475 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.451894 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.583442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:18.591575 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:18.593007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:18.594171 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f418dc4e-d890-4137-a3dc-659bce2f3a3c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.156366 Sep 08 14:03:18.594733 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 228/450] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:18 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:18.852712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-04261070-e45a-4849-b292-1a97f8daf980 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:18.853319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-04261070-e45a-4849-b292-1a97f8daf980 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:18.860137 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-04261070-e45a-4849-b292-1a97f8daf980 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.861140 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-04261070-e45a-4849-b292-1a97f8daf980 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.861597 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-04261070-e45a-4849-b292-1a97f8daf980 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.862290 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-04261070-e45a-4849-b292-1a97f8daf980 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.862741 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-04261070-e45a-4849-b292-1a97f8daf980 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.863242 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-04261070-e45a-4849-b292-1a97f8daf980 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.992038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-04261070-e45a-4849-b292-1a97f8daf980 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:19.000053 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-04261070-e45a-4849-b292-1a97f8daf980 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.151122 Sep 08 14:03:19.000624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 223/451] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:18 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:19.620274 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:19.620871 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:19.627520 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:19.628000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:19.628429 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:19.629149 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:19.629569 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:19.629984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:19.772616 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:19.781897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:19.783966 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:19.785147 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b741fa47-8c55-4e75-ab9b-85013c787615 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.169337 Sep 08 14:03:19.785715 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 229/452] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:19 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:20.024642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a67e46ec-a04b-4bfa-818d-db152822d461 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:20.025212 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a67e46ec-a04b-4bfa-818d-db152822d461 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:20.031857 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a67e46ec-a04b-4bfa-818d-db152822d461 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.032851 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a67e46ec-a04b-4bfa-818d-db152822d461 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.033285 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a67e46ec-a04b-4bfa-818d-db152822d461 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.033987 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a67e46ec-a04b-4bfa-818d-db152822d461 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.034439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a67e46ec-a04b-4bfa-818d-db152822d461 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.034861 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a67e46ec-a04b-4bfa-818d-db152822d461 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.055063 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:20.174578 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a67e46ec-a04b-4bfa-818d-db152822d461 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:20.182303 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a67e46ec-a04b-4bfa-818d-db152822d461 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.161903 Sep 08 14:03:20.182862 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 224/453] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:20 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:20.811867 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:20.812423 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:20.819135 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.819614 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.820041 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.820760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.821208 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.821626 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.963581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:20.972334 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:20.973781 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:20.975051 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7d8c5f83-849f-40a4-8606-c885efcf6b49 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.167133 Sep 08 14:03:20.975611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 230/454] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:20 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:21.205755 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4d320a30-dcd3-424f-84fd-56b7975b7e91 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:21.206584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4d320a30-dcd3-424f-84fd-56b7975b7e91 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:21.213274 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d320a30-dcd3-424f-84fd-56b7975b7e91 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:21.213763 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d320a30-dcd3-424f-84fd-56b7975b7e91 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:21.214200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d320a30-dcd3-424f-84fd-56b7975b7e91 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:21.214939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d320a30-dcd3-424f-84fd-56b7975b7e91 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:21.215395 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d320a30-dcd3-424f-84fd-56b7975b7e91 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:21.215816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d320a30-dcd3-424f-84fd-56b7975b7e91 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:21.354626 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4d320a30-dcd3-424f-84fd-56b7975b7e91 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:21.363277 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4d320a30-dcd3-424f-84fd-56b7975b7e91 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.161776 Sep 08 14:03:21.363809 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 225/455] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:21 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:22.000694 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:22.002007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:22.004338 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:22.009344 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:22.009836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:22.010271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:22.011016 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:22.011476 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:22.011902 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:22.160667 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:22.169037 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:22.170499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:22.171737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4f65fcd0-b977-407e-932b-e7d8715d62e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.175054 Sep 08 14:03:22.172328 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 231/456] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:21 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:22.389430 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f2a106cd-3c79-4097-9c11-c4214a95100d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:22.390408 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f2a106cd-3c79-4097-9c11-c4214a95100d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:22.394143 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:22.398193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2a106cd-3c79-4097-9c11-c4214a95100d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:22.398689 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2a106cd-3c79-4097-9c11-c4214a95100d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:22.399414 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2a106cd-3c79-4097-9c11-c4214a95100d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:22.400173 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2a106cd-3c79-4097-9c11-c4214a95100d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:22.400625 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2a106cd-3c79-4097-9c11-c4214a95100d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:22.401042 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2a106cd-3c79-4097-9c11-c4214a95100d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:22.557554 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f2a106cd-3c79-4097-9c11-c4214a95100d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:22.565731 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f2a106cd-3c79-4097-9c11-c4214a95100d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.182636 Sep 08 14:03:22.566319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 226/457] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:22 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:23.198409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:23.199041 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:23.205882 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.206360 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.206792 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.207530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.207974 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.208397 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.371008 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:23.381169 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:23.382672 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:23.383892 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c0a0528f-5de0-4635-8841-0dc334a63d30 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.189740 Sep 08 14:03:23.384514 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 232/458] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:23 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:23.589923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7122e790-33d2-4c97-ba5f-967836cfc531 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:23.590725 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7122e790-33d2-4c97-ba5f-967836cfc531 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:23.598023 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7122e790-33d2-4c97-ba5f-967836cfc531 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.598539 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7122e790-33d2-4c97-ba5f-967836cfc531 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.598998 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7122e790-33d2-4c97-ba5f-967836cfc531 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.599703 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7122e790-33d2-4c97-ba5f-967836cfc531 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.600156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7122e790-33d2-4c97-ba5f-967836cfc531 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.600597 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7122e790-33d2-4c97-ba5f-967836cfc531 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.765932 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-b801903b-89cc-43ed-b332-c3a1511997c4 req-be1e53d1-3faa-4b77-8efd-f81cbcde8b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe93656-bec8-4094-9b98-062302018a59", "name": "network-vif-plugged", "status": "completed", "tag": "8d168477-404b-4ddb-8747-6423a9c84ab9"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:23.766190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7122e790-33d2-4c97-ba5f-967836cfc531 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:23.783677 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-b801903b-89cc-43ed-b332-c3a1511997c4 req-be1e53d1-3faa-4b77-8efd-f81cbcde8b93 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.784485 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-b801903b-89cc-43ed-b332-c3a1511997c4 req-be1e53d1-3faa-4b77-8efd-f81cbcde8b93 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.784984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-b801903b-89cc-43ed-b332-c3a1511997c4 req-be1e53d1-3faa-4b77-8efd-f81cbcde8b93 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.785181 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7122e790-33d2-4c97-ba5f-967836cfc531 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.198786 Sep 08 14:03:23.786241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 227/459] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:23 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:23.798785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-b801903b-89cc-43ed-b332-c3a1511997c4 req-be1e53d1-3faa-4b77-8efd-f81cbcde8b93 service nova] Creating event network-vif-plugged:8d168477-404b-4ddb-8747-6423a9c84ab9 for instance 5fe93656-bec8-4094-9b98-062302018a59 on hv-cinder-84773 Sep 08 14:03:23.810102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-b801903b-89cc-43ed-b332-c3a1511997c4 req-be1e53d1-3faa-4b77-8efd-f81cbcde8b93 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051445 Sep 08 14:03:23.810851 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 233/460] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:24.409972 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:24.410601 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:24.416722 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.417201 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.417637 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:24.418350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.418855 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.419432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:24.580354 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:24.589424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:24.591126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:24.593347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-382032ba-4b15-478f-a61d-9f3bdb1b5a26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.186150 Sep 08 14:03:24.593347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 228/461] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:24 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:24.823674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-97829679-56b3-4ab0-a0b7-43135cae44d2 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:24.824661 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-97829679-56b3-4ab0-a0b7-43135cae44d2 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:24.831817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-97829679-56b3-4ab0-a0b7-43135cae44d2 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.832269 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-97829679-56b3-4ab0-a0b7-43135cae44d2 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.832714 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-97829679-56b3-4ab0-a0b7-43135cae44d2 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:24.833547 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-97829679-56b3-4ab0-a0b7-43135cae44d2 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.834026 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-97829679-56b3-4ab0-a0b7-43135cae44d2 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.834496 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-97829679-56b3-4ab0-a0b7-43135cae44d2 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:24.984651 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-97829679-56b3-4ab0-a0b7-43135cae44d2 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:24.993615 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-97829679-56b3-4ab0-a0b7-43135cae44d2 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1358 microversion: 2.1 time: 0.176543 Sep 08 14:03:24.994300 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 234/462] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:24 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:25.617933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:25.618583 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:25.625236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.625778 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.626763 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.627498 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.627980 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.628407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.764018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:25.772790 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:25.774591 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:25.775802 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1f92422a-f7c5-466c-abe7-1bcfd4762c01 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.161930 Sep 08 14:03:25.776426 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 229/463] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:25 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:26.017437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-46f38947-d979-4b33-b51a-e9187a9fe976 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:26.018078 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-46f38947-d979-4b33-b51a-e9187a9fe976 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:26.024707 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46f38947-d979-4b33-b51a-e9187a9fe976 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.025195 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46f38947-d979-4b33-b51a-e9187a9fe976 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.025627 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46f38947-d979-4b33-b51a-e9187a9fe976 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.026323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46f38947-d979-4b33-b51a-e9187a9fe976 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.026776 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46f38947-d979-4b33-b51a-e9187a9fe976 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.027241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46f38947-d979-4b33-b51a-e9187a9fe976 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.163370 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-46f38947-d979-4b33-b51a-e9187a9fe976 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.171053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-46f38947-d979-4b33-b51a-e9187a9fe976 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1549 microversion: 2.1 time: 0.157528 Sep 08 14:03:26.171622 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 235/464] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:26 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:26.195980 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6ec250f8-c314-4859-939a-4ecabd8d6920 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:26.196584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6ec250f8-c314-4859-939a-4ecabd8d6920 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:26.202698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ec250f8-c314-4859-939a-4ecabd8d6920 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.203221 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ec250f8-c314-4859-939a-4ecabd8d6920 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.203725 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ec250f8-c314-4859-939a-4ecabd8d6920 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.204826 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ec250f8-c314-4859-939a-4ecabd8d6920 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.205272 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ec250f8-c314-4859-939a-4ecabd8d6920 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.205717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ec250f8-c314-4859-939a-4ecabd8d6920 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.336685 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6ec250f8-c314-4859-939a-4ecabd8d6920 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.344410 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6ec250f8-c314-4859-939a-4ecabd8d6920 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1549 microversion: 2.1 time: 0.152541 Sep 08 14:03:26.345717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 230/465] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:26 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:26.367630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:26.372473 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.373249 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Searching by: {'deleted': False, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7'} {{(pid=133059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 14:03:26.380221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.380701 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.381162 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.381913 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.382364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.382812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.476762 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.multi_cell_list [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=133059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 14:03:26.575218 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b8e491cc-85f9-460e-9e29-2f43a7178eb4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211226 Sep 08 14:03:26.575723 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 236/466] 10.222.0.91 () {58 vars in 1125 bytes} [Thu Sep 8 14:03:26 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:26.588345 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a82d6133-fcef-4cd9-a854-b9fd96097ea9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:26.588953 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a82d6133-fcef-4cd9-a854-b9fd96097ea9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:26.594968 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a82d6133-fcef-4cd9-a854-b9fd96097ea9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.595535 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a82d6133-fcef-4cd9-a854-b9fd96097ea9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.595964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a82d6133-fcef-4cd9-a854-b9fd96097ea9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.596649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a82d6133-fcef-4cd9-a854-b9fd96097ea9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.597104 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a82d6133-fcef-4cd9-a854-b9fd96097ea9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.597505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a82d6133-fcef-4cd9-a854-b9fd96097ea9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.731155 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a82d6133-fcef-4cd9-a854-b9fd96097ea9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.738925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a82d6133-fcef-4cd9-a854-b9fd96097ea9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1549 microversion: 2.1 time: 0.154482 Sep 08 14:03:26.741038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 231/467] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:26 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:26.801303 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:26.802337 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:26.807928 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.809996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.809996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.809996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.809996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.810340 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.949343 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.957459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.958874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.960046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f6693d5d-1b9b-4cd5-9fb9-507437a501b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.162808 Sep 08 14:03:26.960668 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 237/468] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:26 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:27.984757 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:27.985587 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:27.991791 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:27.992267 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:27.992692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:27.993369 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:27.993815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:27.994229 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:28.122649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:28.131393 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:28.132855 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:28.134004 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-705cf312-2393-45aa-9207-85af190c0ee0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1742 microversion: 2.20 time: 0.153248 Sep 08 14:03:28.134573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 232/469] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:27 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:28.661220 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3e192606-4500-4304-8ab4-071ebc2b7e35 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:28.663676 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3e192606-4500-4304-8ab4-071ebc2b7e35 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:28.670135 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e192606-4500-4304-8ab4-071ebc2b7e35 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:28.670625 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e192606-4500-4304-8ab4-071ebc2b7e35 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:28.671093 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e192606-4500-4304-8ab4-071ebc2b7e35 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:28.671791 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e192606-4500-4304-8ab4-071ebc2b7e35 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:28.672244 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e192606-4500-4304-8ab4-071ebc2b7e35 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:28.673176 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3e192606-4500-4304-8ab4-071ebc2b7e35 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:29.161142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:29.161756 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:29.169372 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:29.169870 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:29.170500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:29.172312 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:29.172312 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:29.173524 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:29.310345 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:29.318652 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:29.320138 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:29.321313 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f1a3e913-a258-4236-ae95-f499be9139cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1742 microversion: 2.20 time: 0.164777 Sep 08 14:03:29.321884 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 233/470] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:29 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:03:29.445479 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:29.619842 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3e192606-4500-4304-8ab4-071ebc2b7e35 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "POST /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.962098 Sep 08 14:03:29.620826 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 238/471] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:03:28 2022] POST /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments => generated 194 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:30.347633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:30.348177 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:30.355212 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:30.355693 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:30.356124 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:30.356808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:30.357256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:30.357672 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:30.493588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:30.502145 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:30.503918 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:30.505135 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6f8f0947-4406-4324-9cb8-3c2e1d092069 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1742 microversion: 2.20 time: 0.162015 Sep 08 14:03:30.506005 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 234/472] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:30 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:31.534427 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:31.536545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:31.546860 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:31.549082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:31.549847 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:31.551602 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:31.552332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:31.552979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:31.748060 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:31.764451 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:31.766488 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:31.768096 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3f8d26f4-b902-47fc-9ffc-37031877cfce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1737 microversion: 2.20 time: 0.240899 Sep 08 14:03:31.780155 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 239/473] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:31 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:31.909799 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-21907e40-e530-4c2f-813e-3254d3c3c3f1 req-6f9dc82a-3b2c-41bd-b912-dd578044b2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ba16ca-2c31-48e8-853e-416c2c3bf1fd", "name": "network-vif-plugged", "status": "completed", "tag": "e0a16b6f-cb62-4645-9c10-fa91d5e04946"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:31.929191 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-21907e40-e530-4c2f-813e-3254d3c3c3f1 req-6f9dc82a-3b2c-41bd-b912-dd578044b2bb service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:32.028440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-21907e40-e530-4c2f-813e-3254d3c3c3f1 req-6f9dc82a-3b2c-41bd-b912-dd578044b2bb service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:32.028440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-21907e40-e530-4c2f-813e-3254d3c3c3f1 req-6f9dc82a-3b2c-41bd-b912-dd578044b2bb service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:32.028440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-21907e40-e530-4c2f-813e-3254d3c3c3f1 req-6f9dc82a-3b2c-41bd-b912-dd578044b2bb service nova] Creating event network-vif-plugged:e0a16b6f-cb62-4645-9c10-fa91d5e04946 for instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd on hv-cinder-84773 Sep 08 14:03:32.028440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-21907e40-e530-4c2f-813e-3254d3c3c3f1 req-6f9dc82a-3b2c-41bd-b912-dd578044b2bb service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074047 Sep 08 14:03:32.028440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 235/474] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:32.809128 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:32.810353 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:32.821686 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:32.822933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:32.824122 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:32.825652 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:32.826505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:32.827317 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:33.062906 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:33.075651 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:33.078119 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:33.081112 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b5867423-3364-48bb-bc06-0b4e9ea8129a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1737 microversion: 2.20 time: 0.283418 Sep 08 14:03:33.098927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 240/475] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:32 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1737 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:34.130300 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:34.133785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:34.144858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:34.145658 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:34.146252 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:34.147219 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:34.147879 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:34.148442 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:34.338696 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:34.347767 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:34.349261 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:34.350370 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-107fb089-97d9-474c-b17b-2a436bd9a1b4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1737 microversion: 2.20 time: 0.236124 Sep 08 14:03:34.350960 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 236/476] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:34 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:35.393473 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:35.394534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:35.401892 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:35.402754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:35.403456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:35.404412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:35.405081 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:35.405726 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:35.600526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:35.610141 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:35.612552 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:35.613996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-71848b92-f4e2-4793-b970-84ffb9737f56 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1737 microversion: 2.20 time: 0.224462 Sep 08 14:03:35.626919 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 241/477] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:35 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:36.647766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:36.649818 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:36.661549 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:36.663471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:36.664690 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:36.666717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:36.667824 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:36.668995 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:36.878834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:36.891602 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:36.893243 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:36.894429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3c9455fd-ff18-4849-bf60-437fd241f345 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1737 microversion: 2.20 time: 0.254027 Sep 08 14:03:36.895323 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 237/478] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:36 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:37.926798 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:37.927557 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:37.931243 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:37.938492 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:37.940206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:37.946504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:37.946504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:37.946504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:37.946504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:38.130676 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:38.144238 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:38.149672 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:38.150929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d78b3d27-37a1-43ef-80ba-578cc9a2e9ab tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1737 microversion: 2.20 time: 0.229319 Sep 08 14:03:38.151490 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 242/479] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:37 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:38.508768 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8134fde8-99df-43cf-a312-9851e49b0de1 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:38.509387 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8134fde8-99df-43cf-a312-9851e49b0de1 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:38.515798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8134fde8-99df-43cf-a312-9851e49b0de1 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:38.517022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8134fde8-99df-43cf-a312-9851e49b0de1 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:38.517393 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8134fde8-99df-43cf-a312-9851e49b0de1 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:38.518414 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8134fde8-99df-43cf-a312-9851e49b0de1 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:38.518873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8134fde8-99df-43cf-a312-9851e49b0de1 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:38.519507 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8134fde8-99df-43cf-a312-9851e49b0de1 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:38.666377 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8134fde8-99df-43cf-a312-9851e49b0de1 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:38.675580 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8134fde8-99df-43cf-a312-9851e49b0de1 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1595 microversion: 2.1 time: 0.170904 Sep 08 14:03:38.676152 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 238/480] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:38 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1595 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:39.176899 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:39.178438 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:39.186517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:39.187124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:39.187632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:39.189237 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:39.189947 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:39.190611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:39.762178 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:39.776877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:39.779950 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:39.781371 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-43036c8d-fd16-4fe6-8823-2ae6bf2ca840 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1737 microversion: 2.20 time: 0.609094 Sep 08 14:03:39.786943 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 243/481] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:39 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1737 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:40.815012 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:40.815715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:40.822074 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:40.822552 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:40.823000 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:40.823684 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:40.824125 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:40.824597 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:40.959245 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:40.967454 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:40.968910 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:40.970176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b1169e7e-95d6-46ae-9d76-716d5a692f81 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1737 microversion: 2.20 time: 0.159670 Sep 08 14:03:40.970776 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 239/482] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:40 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:42.003366 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:42.003972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:42.010378 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:42.012071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:42.012071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:42.012071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:42.012400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:42.012813 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:42.203242 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-de99886d-52f2-46b8-ae7d-bed05ad1ac7e req-814dcb16-75aa-430c-aabe-2e617ad29c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe93656-bec8-4094-9b98-062302018a59", "tag": "8d168477-404b-4ddb-8747-6423a9c84ab9"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:42.217812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-de99886d-52f2-46b8-ae7d-bed05ad1ac7e req-814dcb16-75aa-430c-aabe-2e617ad29c9d service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:42.218062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:42.218350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-de99886d-52f2-46b8-ae7d-bed05ad1ac7e req-814dcb16-75aa-430c-aabe-2e617ad29c9d service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:42.218787 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-de99886d-52f2-46b8-ae7d-bed05ad1ac7e req-814dcb16-75aa-430c-aabe-2e617ad29c9d service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:42.227635 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:42.229541 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:42.231350 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e7bb0623-cd33-4c48-9836-466f9efbd887 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1737 microversion: 2.20 time: 0.236027 Sep 08 14:03:42.232130 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 244/483] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:41 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:42.241693 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-de99886d-52f2-46b8-ae7d-bed05ad1ac7e req-814dcb16-75aa-430c-aabe-2e617ad29c9d service nova] Creating event network-changed:8d168477-404b-4ddb-8747-6423a9c84ab9 for instance 5fe93656-bec8-4094-9b98-062302018a59 on hv-cinder-84773 Sep 08 14:03:42.247321 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-de99886d-52f2-46b8-ae7d-bed05ad1ac7e req-814dcb16-75aa-430c-aabe-2e617ad29c9d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047746 Sep 08 14:03:42.248211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 240/484] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:43.263199 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:43.263884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:43.270599 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:43.271857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:43.271857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:43.272431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:43.272886 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:43.273311 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:43.389242 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1926a300-a08b-4213-929c-ffb17a85736b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:43.390144 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1926a300-a08b-4213-929c-ffb17a85736b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:43.400421 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1926a300-a08b-4213-929c-ffb17a85736b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:43.400944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1926a300-a08b-4213-929c-ffb17a85736b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:43.401346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1926a300-a08b-4213-929c-ffb17a85736b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:43.402320 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1926a300-a08b-4213-929c-ffb17a85736b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:43.403646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1926a300-a08b-4213-929c-ffb17a85736b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:43.404672 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1926a300-a08b-4213-929c-ffb17a85736b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:43.605850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:43.614770 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:43.616461 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-1926a300-a08b-4213-929c-ffb17a85736b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lazy-loading 'services' on Instance uuid e6194e5e-54c1-4f8b-a021-be476c67c25e {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:43.620293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:43.621487 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5cbd6bbd-b36b-4d33-bd76-0f3e49aa5a51 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1719 microversion: 2.20 time: 0.364109 Sep 08 14:03:43.629405 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 245/485] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:43 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1719 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:43.853144 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:43.992044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1926a300-a08b-4213-929c-ffb17a85736b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/os-volume_attachments/9660be93-2c2d-4894-ac86-3f9ac6774db7" status: 202 len: 0 microversion: 2.1 time: 0.610034 Sep 08 14:03:43.992867 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 241/486] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:03:43 2022] DELETE /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/os-volume_attachments/9660be93-2c2d-4894-ac86-3f9ac6774db7 => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:03:44.132596 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-fa2b9f9b-3781-407a-b1e4-53e64f133c5c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:44.133193 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-fa2b9f9b-3781-407a-b1e4-53e64f133c5c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:44.145107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa2b9f9b-3781-407a-b1e4-53e64f133c5c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.145107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa2b9f9b-3781-407a-b1e4-53e64f133c5c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.145107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa2b9f9b-3781-407a-b1e4-53e64f133c5c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.145107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa2b9f9b-3781-407a-b1e4-53e64f133c5c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.145459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa2b9f9b-3781-407a-b1e4-53e64f133c5c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.145459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa2b9f9b-3781-407a-b1e4-53e64f133c5c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.183731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-fa2b9f9b-3781-407a-b1e4-53e64f133c5c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b/ips" status: 200 len: 150 microversion: 2.1 time: 0.054824 Sep 08 14:03:44.185035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 246/487] 10.222.0.91 () {58 vars in 1248 bytes} [Thu Sep 8 14:03:44 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:44.199875 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "150774fe-8124-43ba-9a58-7690634aca85"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:44.202422 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:44.210733 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.211585 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.212008 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.212883 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.213506 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.213944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.306244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Invalid volume: volume 150774fe-8124-43ba-9a58-7690634aca85 is already attached to instances: edd10060-2469-49e3-a8c3-949a359181f8 Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: POST /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b/os-volume_attachments HTTP/1.1 Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 74 Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:03:44.308046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {"volumeAttachment": {"volumeId": "150774fe-8124-43ba-9a58-7690634aca85"}} Sep 08 14:03:44.309642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Invalid volume: volume 150774fe-8124-43ba-9a58-7690634aca85 is already attached to instances: edd10060-2469-49e3-a8c3-949a359181f8 Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'server_id': '175ddc71-f731-4fa7-8de5-245b36c3c13b', 'body': {'volumeAttachment': {'volumeId': '150774fe-8124-43ba-9a58-7690634aca85'}}} Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 150774fe-8124-43ba-9a58-7690634aca85 is already attached to instances: edd10060-2469-49e3-a8c3-949a359181f8 Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:03:44.310610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 150774fe-8124-43ba-9a58-7690634aca85 is already attached to instances: edd10060-2469-49e3-a8c3-949a359181f8 Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:44.312033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:44.313996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:44.313996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:03:44.313996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:03:44.313996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 150774fe-8124-43ba-9a58-7690634aca85 is already attached to instances: edd10060-2469-49e3-a8c3-949a359181f8 Sep 08 14:03:44.313996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:03:44.313996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 400 to user: Invalid volume: volume 150774fe-8124-43ba-9a58-7690634aca85 is already attached to instances: edd10060-2469-49e3-a8c3-949a359181f8 {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:03:44.313996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d0180b11-7f3d-4bc5-929a-761e11149512 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114325 Sep 08 14:03:44.313996 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 242/488] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:03:44 2022] POST /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:03:44.319633 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c951b184-827c-40ee-85a3-3a2951273241 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:44.320130 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c951b184-827c-40ee-85a3-3a2951273241 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:44.327108 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c951b184-827c-40ee-85a3-3a2951273241 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.327638 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c951b184-827c-40ee-85a3-3a2951273241 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.328072 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c951b184-827c-40ee-85a3-3a2951273241 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.328863 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c951b184-827c-40ee-85a3-3a2951273241 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.329768 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c951b184-827c-40ee-85a3-3a2951273241 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.329768 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c951b184-827c-40ee-85a3-3a2951273241 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.354951 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c951b184-827c-40ee-85a3-3a2951273241 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Going to try to terminate instance {{(pid=133059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:03:44.654124 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:44.654737 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:44.662439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.662962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.663390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.664107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.664640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.665074 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.681379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c951b184-827c-40ee-85a3-3a2951273241 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 204 len: 0 microversion: 2.1 time: 0.362276 Sep 08 14:03:44.681379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 247/489] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:03:44 2022] DELETE /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:03:44.692805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8f885877-9b23-40f6-9228-73e5bfbf5a6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:44.693671 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8f885877-9b23-40f6-9228-73e5bfbf5a6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:44.699841 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f885877-9b23-40f6-9228-73e5bfbf5a6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.700288 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f885877-9b23-40f6-9228-73e5bfbf5a6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.700716 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f885877-9b23-40f6-9228-73e5bfbf5a6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.701409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f885877-9b23-40f6-9228-73e5bfbf5a6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.701854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f885877-9b23-40f6-9228-73e5bfbf5a6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.702269 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f885877-9b23-40f6-9228-73e5bfbf5a6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.816422 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:44.826562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:44.828058 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:44.829216 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-187efbc1-5d37-4e46-8c69-7c3d74fdb380 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1719 microversion: 2.20 time: 0.180249 Sep 08 14:03:44.829769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 243/490] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:44 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:03:44.867300 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8f885877-9b23-40f6-9228-73e5bfbf5a6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:44.875538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8f885877-9b23-40f6-9228-73e5bfbf5a6f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1681 microversion: 2.1 time: 0.192048 Sep 08 14:03:44.878153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 248/491] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:44 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:45.094122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e8991ab6-421c-4e25-90d3-d0c2e90e2658 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1263109879"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:45.095304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e8991ab6-421c-4e25-90d3-d0c2e90e2658 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:45.101606 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8991ab6-421c-4e25-90d3-d0c2e90e2658 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.102091 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8991ab6-421c-4e25-90d3-d0c2e90e2658 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.102540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8991ab6-421c-4e25-90d3-d0c2e90e2658 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.103336 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8991ab6-421c-4e25-90d3-d0c2e90e2658 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.103741 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8991ab6-421c-4e25-90d3-d0c2e90e2658 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.104164 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8991ab6-421c-4e25-90d3-d0c2e90e2658 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.239216 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.network.security_group_api [None req-e8991ab6-421c-4e25-90d3-d0c2e90e2658 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Adding security group 1fbcf4ad-61f7-4d3a-bc49-9be81697fc49 to port 8d168477-404b-4ddb-8747-6423a9c84ab9 Sep 08 14:03:45.629483 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e8991ab6-421c-4e25-90d3-d0c2e90e2658 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "POST /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/action" status: 202 len: 0 microversion: 2.1 time: 0.539261 Sep 08 14:03:45.630149 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 244/492] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:03:45 2022] POST /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:03:45.638611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7e31f058-055d-4a50-a86b-a5536551b77a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:45.639272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7e31f058-055d-4a50-a86b-a5536551b77a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:45.639502 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-b09393d9-e57c-4d60-b835-b47e40bbf758 req-dc2053ac-414a-48d6-8d43-20f685db541c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe93656-bec8-4094-9b98-062302018a59", "tag": "8d168477-404b-4ddb-8747-6423a9c84ab9"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:45.648834 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e31f058-055d-4a50-a86b-a5536551b77a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.654977 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e31f058-055d-4a50-a86b-a5536551b77a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.654977 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e31f058-055d-4a50-a86b-a5536551b77a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.654977 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e31f058-055d-4a50-a86b-a5536551b77a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.655306 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-b09393d9-e57c-4d60-b835-b47e40bbf758 req-dc2053ac-414a-48d6-8d43-20f685db541c service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.655306 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-b09393d9-e57c-4d60-b835-b47e40bbf758 req-dc2053ac-414a-48d6-8d43-20f685db541c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.655927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e31f058-055d-4a50-a86b-a5536551b77a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.656020 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-b09393d9-e57c-4d60-b835-b47e40bbf758 req-dc2053ac-414a-48d6-8d43-20f685db541c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.656115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e31f058-055d-4a50-a86b-a5536551b77a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.668153 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-b09393d9-e57c-4d60-b835-b47e40bbf758 req-dc2053ac-414a-48d6-8d43-20f685db541c service nova] Creating event network-changed:8d168477-404b-4ddb-8747-6423a9c84ab9 for instance 5fe93656-bec8-4094-9b98-062302018a59 on hv-cinder-84773 Sep 08 14:03:45.674462 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-b09393d9-e57c-4d60-b835-b47e40bbf758 req-dc2053ac-414a-48d6-8d43-20f685db541c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038834 Sep 08 14:03:45.675712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 245/493] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:45.809137 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7e31f058-055d-4a50-a86b-a5536551b77a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:45.818369 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7e31f058-055d-4a50-a86b-a5536551b77a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1761 microversion: 2.1 time: 0.183844 Sep 08 14:03:45.818996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 249/494] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:45 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1761 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:45.855868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:45.856562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:45.863618 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.864105 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.864606 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.865235 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.865681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.866098 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.913672 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f9d4551a-4e92-4679-8728-1e206373b2af tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:45.914292 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f9d4551a-4e92-4679-8728-1e206373b2af tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:45.921320 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9d4551a-4e92-4679-8728-1e206373b2af tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.921815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9d4551a-4e92-4679-8728-1e206373b2af tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.922245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9d4551a-4e92-4679-8728-1e206373b2af tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.923056 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9d4551a-4e92-4679-8728-1e206373b2af tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.923505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9d4551a-4e92-4679-8728-1e206373b2af tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.923928 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9d4551a-4e92-4679-8728-1e206373b2af tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:46.070445 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:46.082251 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:46.084004 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:46.085362 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-78a779b3-1921-452b-bea5-cdfc4d66e970 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1719 microversion: 2.20 time: 0.233987 Sep 08 14:03:46.086652 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 246/495] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:45 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1719 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:46.097485 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f9d4551a-4e92-4679-8728-1e206373b2af tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:46.114016 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f9d4551a-4e92-4679-8728-1e206373b2af tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1681 microversion: 2.1 time: 0.217035 Sep 08 14:03:46.114796 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 250/496] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:45 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:47.113496 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:47.114102 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:47.120817 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.121376 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.121808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.122525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.123020 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.123441 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.140435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d84f08b4-3891-4293-a6e4-beb16e454fc6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:47.141047 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d84f08b4-3891-4293-a6e4-beb16e454fc6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:47.147675 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d84f08b4-3891-4293-a6e4-beb16e454fc6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.148235 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d84f08b4-3891-4293-a6e4-beb16e454fc6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.148863 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d84f08b4-3891-4293-a6e4-beb16e454fc6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.149857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d84f08b4-3891-4293-a6e4-beb16e454fc6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.150319 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d84f08b4-3891-4293-a6e4-beb16e454fc6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.150743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d84f08b4-3891-4293-a6e4-beb16e454fc6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.287766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:47.297036 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:47.304267 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:47.304267 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0571313f-862f-4eaf-bb26-d5f376952959 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1719 microversion: 2.20 time: 0.191197 Sep 08 14:03:47.304267 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 247/497] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:47 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1719 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:03:47.315730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d84f08b4-3891-4293-a6e4-beb16e454fc6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:47.323323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d84f08b4-3891-4293-a6e4-beb16e454fc6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1681 microversion: 2.1 time: 0.186814 Sep 08 14:03:47.323899 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 251/498] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:47 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:47.721630 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-83059142-69f0-4e56-94b2-bd5ae8615837 req-a8070cdb-bde5-4c34-a037-004ef7b2792e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ba16ca-2c31-48e8-853e-416c2c3bf1fd", "name": "network-vif-unplugged", "status": "completed", "tag": "e0a16b6f-cb62-4645-9c10-fa91d5e04946"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:47.731799 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-83059142-69f0-4e56-94b2-bd5ae8615837 req-a8070cdb-bde5-4c34-a037-004ef7b2792e service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.732198 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-83059142-69f0-4e56-94b2-bd5ae8615837 req-a8070cdb-bde5-4c34-a037-004ef7b2792e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.732628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-83059142-69f0-4e56-94b2-bd5ae8615837 req-a8070cdb-bde5-4c34-a037-004ef7b2792e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.747222 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-83059142-69f0-4e56-94b2-bd5ae8615837 req-a8070cdb-bde5-4c34-a037-004ef7b2792e service nova] Creating event network-vif-unplugged:e0a16b6f-cb62-4645-9c10-fa91d5e04946 for instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd on hv-cinder-84773 Sep 08 14:03:47.752083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-83059142-69f0-4e56-94b2-bd5ae8615837 req-a8070cdb-bde5-4c34-a037-004ef7b2792e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035789 Sep 08 14:03:47.752676 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 248/499] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:48.342000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:48.348586 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6b3feb0a-09a1-4439-a70b-86cca8d81090 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:48.352013 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:48.353546 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6b3feb0a-09a1-4439-a70b-86cca8d81090 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:48.360152 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:48.360655 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:48.364263 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b3feb0a-09a1-4439-a70b-86cca8d81090 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:48.365000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:48.365739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:48.366205 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:48.366653 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:48.372648 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b3feb0a-09a1-4439-a70b-86cca8d81090 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:48.373108 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b3feb0a-09a1-4439-a70b-86cca8d81090 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:48.373844 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b3feb0a-09a1-4439-a70b-86cca8d81090 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:48.374488 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b3feb0a-09a1-4439-a70b-86cca8d81090 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:48.374939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b3feb0a-09a1-4439-a70b-86cca8d81090 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:48.517224 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:48.531078 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6b3feb0a-09a1-4439-a70b-86cca8d81090 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:48.539208 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6b3feb0a-09a1-4439-a70b-86cca8d81090 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1681 microversion: 2.1 time: 0.195220 Sep 08 14:03:48.539833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 249/500] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:48 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:48.540546 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:48.541950 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:48.543177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-803a3573-8e0b-40d1-badc-4d4dd444ddd4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1719 microversion: 2.20 time: 0.205159 Sep 08 14:03:48.543733 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 252/501] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:48 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1719 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:49.563131 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0468fb52-38f5-4675-92a8-8a6d79736eb5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:49.565613 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0468fb52-38f5-4675-92a8-8a6d79736eb5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:49.572790 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0468fb52-38f5-4675-92a8-8a6d79736eb5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:49.573551 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0468fb52-38f5-4675-92a8-8a6d79736eb5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:49.574148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0468fb52-38f5-4675-92a8-8a6d79736eb5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:49.575202 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0468fb52-38f5-4675-92a8-8a6d79736eb5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:49.575726 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:49.576310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0468fb52-38f5-4675-92a8-8a6d79736eb5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:49.576889 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0468fb52-38f5-4675-92a8-8a6d79736eb5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:49.579350 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:49.589892 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:49.590416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:49.591081 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:49.591930 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:49.592383 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:49.592806 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:49.763389 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0468fb52-38f5-4675-92a8-8a6d79736eb5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:49.772299 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0468fb52-38f5-4675-92a8-8a6d79736eb5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1681 microversion: 2.1 time: 0.213297 Sep 08 14:03:49.772888 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 250/502] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:49 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:50.046809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:50.050376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:50.056222 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:50.057736 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:50.058931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-344c0e96-b97a-4524-92bb-6bdefa1af747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1722 microversion: 2.20 time: 0.491026 Sep 08 14:03:50.059504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 253/503] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:49 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1722 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:50.085407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e7c57754-0c2c-4ea2-ad77-d4ac3545ee6a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e767ddac-b32f-4c8d-9973-5409ea9c05dd"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:50.087738 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e7c57754-0c2c-4ea2-ad77-d4ac3545ee6a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:50.099715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e7c57754-0c2c-4ea2-ad77-d4ac3545ee6a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.099715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e7c57754-0c2c-4ea2-ad77-d4ac3545ee6a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.099715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e7c57754-0c2c-4ea2-ad77-d4ac3545ee6a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.099715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e7c57754-0c2c-4ea2-ad77-d4ac3545ee6a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.100098 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e7c57754-0c2c-4ea2-ad77-d4ac3545ee6a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.100098 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e7c57754-0c2c-4ea2-ad77-d4ac3545ee6a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.450734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-e62448dd-03bc-4904-b36a-5c94f501ffe1 req-6cdba38d-ceef-4cc3-ab17-38c79387cc77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175ddc71-f731-4fa7-8de5-245b36c3c13b", "name": "network-vif-deleted", "tag": "3f1d12fa-8092-409f-bf87-a97dd8a63d43"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:50.461722 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-e62448dd-03bc-4904-b36a-5c94f501ffe1 req-6cdba38d-ceef-4cc3-ab17-38c79387cc77 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.462425 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-e62448dd-03bc-4904-b36a-5c94f501ffe1 req-6cdba38d-ceef-4cc3-ab17-38c79387cc77 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.463056 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-e62448dd-03bc-4904-b36a-5c94f501ffe1 req-6cdba38d-ceef-4cc3-ab17-38c79387cc77 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.477767 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-e62448dd-03bc-4904-b36a-5c94f501ffe1 req-6cdba38d-ceef-4cc3-ab17-38c79387cc77 service nova] Creating event network-vif-deleted:3f1d12fa-8092-409f-bf87-a97dd8a63d43 for instance 175ddc71-f731-4fa7-8de5-245b36c3c13b on hv-cinder-84773 Sep 08 14:03:50.490221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-e62448dd-03bc-4904-b36a-5c94f501ffe1 req-6cdba38d-ceef-4cc3-ab17-38c79387cc77 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037807 Sep 08 14:03:50.492908 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 254/504] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:50.509669 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-700874b9-d417-43f9-83a5-dc26466f549a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:50.519818 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-700874b9-d417-43f9-83a5-dc26466f549a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.520219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-700874b9-d417-43f9-83a5-dc26466f549a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.520905 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-700874b9-d417-43f9-83a5-dc26466f549a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.552376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-700874b9-d417-43f9-83a5-dc26466f549a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Going to try to stop instance {{(pid=133059) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 14:03:50.798873 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-700874b9-d417-43f9-83a5-dc26466f549a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/action" status: 202 len: 0 microversion: 2.1 time: 0.299842 Sep 08 14:03:50.799588 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 255/505] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:03:50 2022] POST /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:03:50.806287 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0811fbbf-5f63-4a75-a412-71eff0623387 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:50.807930 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0811fbbf-5f63-4a75-a412-71eff0623387 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:50.816298 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0811fbbf-5f63-4a75-a412-71eff0623387 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.816771 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0811fbbf-5f63-4a75-a412-71eff0623387 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.817562 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0811fbbf-5f63-4a75-a412-71eff0623387 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.818035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0811fbbf-5f63-4a75-a412-71eff0623387 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.818568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0811fbbf-5f63-4a75-a412-71eff0623387 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.819343 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0811fbbf-5f63-4a75-a412-71eff0623387 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.905660 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0811fbbf-5f63-4a75-a412-71eff0623387 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:50.914731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0811fbbf-5f63-4a75-a412-71eff0623387 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1326 microversion: 2.1 time: 0.113690 Sep 08 14:03:50.915457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 256/506] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:50 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1326 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:50.919969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-49cd40f0-3e82-4520-8ed4-88f299ccb33b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:50.920570 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-49cd40f0-3e82-4520-8ed4-88f299ccb33b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:50.927149 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-49cd40f0-3e82-4520-8ed4-88f299ccb33b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.928027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-49cd40f0-3e82-4520-8ed4-88f299ccb33b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.928436 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-49cd40f0-3e82-4520-8ed4-88f299ccb33b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.929234 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-49cd40f0-3e82-4520-8ed4-88f299ccb33b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.929770 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-49cd40f0-3e82-4520-8ed4-88f299ccb33b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.930261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-49cd40f0-3e82-4520-8ed4-88f299ccb33b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:51.110559 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-49cd40f0-3e82-4520-8ed4-88f299ccb33b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:51.119709 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-49cd40f0-3e82-4520-8ed4-88f299ccb33b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1679 microversion: 2.1 time: 0.203195 Sep 08 14:03:51.120429 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 257/507] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:50 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1679 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:51.300982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e7c57754-0c2c-4ea2-ad77-d4ac3545ee6a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "POST /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.219236 Sep 08 14:03:51.301904 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 251/508] 10.222.0.91 () {62 vars in 1364 bytes} [Thu Sep 8 14:03:50 2022] POST /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments => generated 188 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 14:03:51.442540 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-09c3a164-99c6-43d8-9652-fefbe4223869 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:51.443164 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-09c3a164-99c6-43d8-9652-fefbe4223869 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:51.451897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09c3a164-99c6-43d8-9652-fefbe4223869 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:51.452777 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09c3a164-99c6-43d8-9652-fefbe4223869 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:51.453587 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09c3a164-99c6-43d8-9652-fefbe4223869 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:51.454963 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09c3a164-99c6-43d8-9652-fefbe4223869 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:51.455705 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09c3a164-99c6-43d8-9652-fefbe4223869 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:51.456390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-09c3a164-99c6-43d8-9652-fefbe4223869 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:51.527413 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-09c3a164-99c6-43d8-9652-fefbe4223869 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133059) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 14:03:51.865784 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-09c3a164-99c6-43d8-9652-fefbe4223869 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "POST /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/action" status: 202 len: 0 microversion: 2.20 time: 0.427039 Sep 08 14:03:51.868318 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 258/509] 10.222.0.91 () {62 vars in 1319 bytes} [Thu Sep 8 14:03:51 2022] POST /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:03:51.877304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:51.878039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:51.885826 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:51.886319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:51.887026 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:51.888318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:51.888786 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:51.889221 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:51.940163 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:51.940755 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:51.954701 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:51.955235 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:51.955722 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:51.956464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:51.956927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:51.957359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:52.055370 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:52.055969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:52.056516 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:52.057133 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lazy-loading 'fault' on Instance uuid 175ddc71-f731-4fa7-8de5-245b36c3c13b {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:52.116937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:52.118277 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:52.129002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-20c78320-c804-4bc2-b1d6-bf4e7357549b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 200 len: 1331 microversion: 2.1 time: 0.194185 Sep 08 14:03:52.138961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 259/510] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:51 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 1331 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:52.139193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:52.139193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:52.139193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-143f1dab-408d-4525-9b0f-76ffe96a42c9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1748 microversion: 2.20 time: 0.261283 Sep 08 14:03:52.139477 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 252/511] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:51 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1748 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:03:52.144179 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-91d79f94-b789-425b-8875-e567fe582bcb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:52.144797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-91d79f94-b789-425b-8875-e567fe582bcb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:52.152811 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:52.157663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91d79f94-b789-425b-8875-e567fe582bcb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:52.158147 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91d79f94-b789-425b-8875-e567fe582bcb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:52.161024 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91d79f94-b789-425b-8875-e567fe582bcb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:52.161024 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91d79f94-b789-425b-8875-e567fe582bcb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:52.161024 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91d79f94-b789-425b-8875-e567fe582bcb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:52.161024 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91d79f94-b789-425b-8875-e567fe582bcb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:52.331214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-91d79f94-b789-425b-8875-e567fe582bcb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:52.340329 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-91d79f94-b789-425b-8875-e567fe582bcb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1679 microversion: 2.1 time: 0.199678 Sep 08 14:03:52.340641 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 260/512] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:52 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:53.154016 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:53.154611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:53.157205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=54 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:53.163142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.163698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.164189 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.164978 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.165324 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:53.165831 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.166083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.166678 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:53.174475 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.175263 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.175862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.176737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.177354 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.177972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.182236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b HTTP/1.1 Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:03:53.183923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:03:53.191400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '175ddc71-f731-4fa7-8de5-245b36c3c13b'} Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:03:53.194043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:03:53.197810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:03:53.201347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:03:53.201347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d2ee7eed-46fe-4462-8792-2bd4f626cdf0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 404 len: 111 microversion: 2.1 time: 0.035212 Sep 08 14:03:53.201347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 253/513] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:53 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:03:53.201347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-acc7b37b-c647-4fa5-9e28-b62af14bde42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '.version_select at 0x7f51fbfeec10>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:53.337083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-acc7b37b-c647-4fa5-9e28-b62af14bde42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032411369" status: 202 len: 0 microversion: 2.1 time: 0.145668 Sep 08 14:03:53.341204 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 254/514] 10.222.0.91 () {58 vars in 1221 bytes} [Thu Sep 8 14:03:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032411369 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:03:53.355042 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:53.367645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:53.369096 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:53.370815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2cb0e3c4-2296-4567-b940-11041065dabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1748 microversion: 2.20 time: 0.209015 Sep 08 14:03:53.371746 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 261/515] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:53 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1748 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:03:53.387906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-12faa823-0c90-4704-856f-750a846b00c4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:53.388685 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-12faa823-0c90-4704-856f-750a846b00c4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:53.398517 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12faa823-0c90-4704-856f-750a846b00c4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.399452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12faa823-0c90-4704-856f-750a846b00c4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.400038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12faa823-0c90-4704-856f-750a846b00c4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.400880 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12faa823-0c90-4704-856f-750a846b00c4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.401586 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12faa823-0c90-4704-856f-750a846b00c4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.402222 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12faa823-0c90-4704-856f-750a846b00c4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.579497 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-12faa823-0c90-4704-856f-750a846b00c4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:53.587609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-12faa823-0c90-4704-856f-750a846b00c4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1679 microversion: 2.1 time: 0.226469 Sep 08 14:03:53.588172 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 255/516] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:53 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:53.896971 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5e36eb05-64c4-4858-aaf7-e75991a0d546 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37b93427-dda3-4721-aee6-72d8c2e29925"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:53.899936 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5e36eb05-64c4-4858-aaf7-e75991a0d546 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:53.906105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e36eb05-64c4-4858-aaf7-e75991a0d546 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.907362 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e36eb05-64c4-4858-aaf7-e75991a0d546 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.907587 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e36eb05-64c4-4858-aaf7-e75991a0d546 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.908321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e36eb05-64c4-4858-aaf7-e75991a0d546 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.908780 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e36eb05-64c4-4858-aaf7-e75991a0d546 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.909196 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e36eb05-64c4-4858-aaf7-e75991a0d546 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.280967 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-098da0e9-caec-4acb-9184-dca5e964cf60 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:54.281547 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-098da0e9-caec-4acb-9184-dca5e964cf60 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:54.288251 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-098da0e9-caec-4acb-9184-dca5e964cf60 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.288732 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-098da0e9-caec-4acb-9184-dca5e964cf60 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.289162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-098da0e9-caec-4acb-9184-dca5e964cf60 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.289853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-098da0e9-caec-4acb-9184-dca5e964cf60 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.290428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-098da0e9-caec-4acb-9184-dca5e964cf60 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.290853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-098da0e9-caec-4acb-9184-dca5e964cf60 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.380856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-098da0e9-caec-4acb-9184-dca5e964cf60 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lazy-loading 'services' on Instance uuid edd10060-2469-49e3-a8c3-949a359181f8 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:54.602234 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-098da0e9-caec-4acb-9184-dca5e964cf60 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-volume_attachments/150774fe-8124-43ba-9a58-7690634aca85" status: 202 len: 0 microversion: 2.1 time: 0.324961 Sep 08 14:03:54.602769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 256/517] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:03:54 2022] DELETE /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-volume_attachments/150774fe-8124-43ba-9a58-7690634aca85 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:03:54.608216 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:54.608910 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:54.615589 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.616086 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.616524 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.617239 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.617694 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.618118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.778410 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:54.791978 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:54.794298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:54.796207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-bb38d687-12b6-4729-a58e-765a50183518 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1750 microversion: 2.20 time: 0.191877 Sep 08 14:03:54.797046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 257/518] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:54 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1750 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:54.804166 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-01d548a2-886f-4fec-81ea-f716955c0df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:54.804997 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-01d548a2-886f-4fec-81ea-f716955c0df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:54.811342 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01d548a2-886f-4fec-81ea-f716955c0df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.811833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01d548a2-886f-4fec-81ea-f716955c0df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.812270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01d548a2-886f-4fec-81ea-f716955c0df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.813582 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01d548a2-886f-4fec-81ea-f716955c0df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.813989 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01d548a2-886f-4fec-81ea-f716955c0df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.814410 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01d548a2-886f-4fec-81ea-f716955c0df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.833722 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:54.952936 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-01d548a2-886f-4fec-81ea-f716955c0df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:54.960684 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-01d548a2-886f-4fec-81ea-f716955c0df0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1679 microversion: 2.1 time: 0.161957 Sep 08 14:03:54.974920 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 258/519] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:54 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:54.974920 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-803fdad9-a84f-4a14-9f0b-a849da8e2179 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:54.974920 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-803fdad9-a84f-4a14-9f0b-a849da8e2179 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:54.979101 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-803fdad9-a84f-4a14-9f0b-a849da8e2179 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.979215 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-803fdad9-a84f-4a14-9f0b-a849da8e2179 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.979647 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-803fdad9-a84f-4a14-9f0b-a849da8e2179 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.980345 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-803fdad9-a84f-4a14-9f0b-a849da8e2179 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.980798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-803fdad9-a84f-4a14-9f0b-a849da8e2179 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.981224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-803fdad9-a84f-4a14-9f0b-a849da8e2179 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:55.015816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-803fdad9-a84f-4a14-9f0b-a849da8e2179 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050158 Sep 08 14:03:55.016743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 259/520] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:54 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:55.025621 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5e36eb05-64c4-4858-aaf7-e75991a0d546 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.132753 Sep 08 14:03:55.032052 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 262/521] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:03:53 2022] POST /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments => generated 194 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:55.828103 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:55.829357 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:55.836669 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:55.837159 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:55.837802 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:55.838634 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:55.838818 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:55.839411 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:55.986042 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9e089f66-f235-4846-9cfa-8ba5bf74a2e1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:55.986935 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9e089f66-f235-4846-9cfa-8ba5bf74a2e1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:55.993758 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9e089f66-f235-4846-9cfa-8ba5bf74a2e1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:55.993920 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:55.994385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9e089f66-f235-4846-9cfa-8ba5bf74a2e1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:55.994844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9e089f66-f235-4846-9cfa-8ba5bf74a2e1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:55.995597 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9e089f66-f235-4846-9cfa-8ba5bf74a2e1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:55.996502 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9e089f66-f235-4846-9cfa-8ba5bf74a2e1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:55.998437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9e089f66-f235-4846-9cfa-8ba5bf74a2e1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:56.004307 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:56.005766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:56.006951 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7eed40dc-e459-4522-84ad-b924c0849c2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1750 microversion: 2.20 time: 0.183395 Sep 08 14:03:56.007512 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 260/522] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:55 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:56.034815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-11f82859-62c8-4094-a382-3ba536a8d553 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:56.038550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-11f82859-62c8-4094-a382-3ba536a8d553 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:56.045933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11f82859-62c8-4094-a382-3ba536a8d553 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:56.046431 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11f82859-62c8-4094-a382-3ba536a8d553 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:56.046839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11f82859-62c8-4094-a382-3ba536a8d553 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:56.047697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11f82859-62c8-4094-a382-3ba536a8d553 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:56.048144 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11f82859-62c8-4094-a382-3ba536a8d553 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:56.048629 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11f82859-62c8-4094-a382-3ba536a8d553 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:56.083854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-11f82859-62c8-4094-a382-3ba536a8d553 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055957 Sep 08 14:03:56.084452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 261/523] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:56 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:56.172599 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9e089f66-f235-4846-9cfa-8ba5bf74a2e1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:56.182389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9e089f66-f235-4846-9cfa-8ba5bf74a2e1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1679 microversion: 2.1 time: 0.201161 Sep 08 14:03:56.186968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 263/524] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:55 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:57.035709 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:57.036614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:57.044930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.045422 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.045911 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.046609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.047148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.047571 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.101131 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8af68e7b-44ff-46e8-860c-e3c1b6cd9f83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:57.103545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8af68e7b-44ff-46e8-860c-e3c1b6cd9f83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:57.110229 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8af68e7b-44ff-46e8-860c-e3c1b6cd9f83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.110831 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8af68e7b-44ff-46e8-860c-e3c1b6cd9f83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.111414 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8af68e7b-44ff-46e8-860c-e3c1b6cd9f83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.112364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8af68e7b-44ff-46e8-860c-e3c1b6cd9f83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.113062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8af68e7b-44ff-46e8-860c-e3c1b6cd9f83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.113550 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8af68e7b-44ff-46e8-860c-e3c1b6cd9f83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.150270 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8af68e7b-44ff-46e8-860c-e3c1b6cd9f83 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055634 Sep 08 14:03:57.157506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 264/525] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:57 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 14:03:57.216610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-294a829e-a668-485e-9ec3-93745d920b4a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:57.217301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-294a829e-a668-485e-9ec3-93745d920b4a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:57.218558 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:57.231370 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:57.232563 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:57.234272 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-65af6b9b-00d1-4cc2-82d1-27142a093e9e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.204372 Sep 08 14:03:57.235874 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 262/526] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:57 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:03:57.241153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-294a829e-a668-485e-9ec3-93745d920b4a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.241979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-294a829e-a668-485e-9ec3-93745d920b4a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.243005 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-294a829e-a668-485e-9ec3-93745d920b4a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.244205 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-294a829e-a668-485e-9ec3-93745d920b4a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.245010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-294a829e-a668-485e-9ec3-93745d920b4a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.246123 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-294a829e-a668-485e-9ec3-93745d920b4a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.269400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0226f19c-055f-4c8e-99d1-10e22abc2268 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:57.270293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0226f19c-055f-4c8e-99d1-10e22abc2268 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:57.278841 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0226f19c-055f-4c8e-99d1-10e22abc2268 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.279449 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0226f19c-055f-4c8e-99d1-10e22abc2268 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.279887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0226f19c-055f-4c8e-99d1-10e22abc2268 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.280791 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0226f19c-055f-4c8e-99d1-10e22abc2268 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.281271 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0226f19c-055f-4c8e-99d1-10e22abc2268 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.281725 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0226f19c-055f-4c8e-99d1-10e22abc2268 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.316163 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0226f19c-055f-4c8e-99d1-10e22abc2268 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:03:57.491655 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-294a829e-a668-485e-9ec3-93745d920b4a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:57.500718 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-294a829e-a668-485e-9ec3-93745d920b4a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1679 microversion: 2.1 time: 0.295422 Sep 08 14:03:57.501327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 265/527] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:57 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1679 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:57.691361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0226f19c-055f-4c8e-99d1-10e22abc2268 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 204 len: 0 microversion: 2.1 time: 0.437801 Sep 08 14:03:57.692035 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 263/528] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:03:57 2022] DELETE /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:03:57.701125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6bf4dd31-843e-488b-917a-7408a18d0e51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:57.701897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6bf4dd31-843e-488b-917a-7408a18d0e51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:57.708804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6bf4dd31-843e-488b-917a-7408a18d0e51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.709277 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6bf4dd31-843e-488b-917a-7408a18d0e51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.709712 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6bf4dd31-843e-488b-917a-7408a18d0e51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.710456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6bf4dd31-843e-488b-917a-7408a18d0e51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.710926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6bf4dd31-843e-488b-917a-7408a18d0e51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.711476 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6bf4dd31-843e-488b-917a-7408a18d0e51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.860346 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-6bf4dd31-843e-488b-917a-7408a18d0e51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:57.869022 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6bf4dd31-843e-488b-917a-7408a18d0e51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1683 microversion: 2.1 time: 0.172266 Sep 08 14:03:57.869610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 266/529] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:57 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:58.278095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:58.278857 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:58.286036 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:58.286565 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:58.286995 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:58.287766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:58.288207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:58.288621 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:58.464444 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:58.473855 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:58.475648 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:58.476986 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-919e2777-8207-403e-a955-461a1363f603 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.203357 Sep 08 14:03:58.477560 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 264/530] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:58 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:58.537231 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-882ebe9b-346b-4935-aa0d-3b0fbc10145e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:58.537799 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-882ebe9b-346b-4935-aa0d-3b0fbc10145e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:58.544385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-882ebe9b-346b-4935-aa0d-3b0fbc10145e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:58.544877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-882ebe9b-346b-4935-aa0d-3b0fbc10145e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:58.545313 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-882ebe9b-346b-4935-aa0d-3b0fbc10145e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:58.546015 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-882ebe9b-346b-4935-aa0d-3b0fbc10145e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:58.546472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-882ebe9b-346b-4935-aa0d-3b0fbc10145e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:58.546913 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-882ebe9b-346b-4935-aa0d-3b0fbc10145e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:58.566921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:58.685065 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-882ebe9b-346b-4935-aa0d-3b0fbc10145e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:58.694420 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-882ebe9b-346b-4935-aa0d-3b0fbc10145e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1679 microversion: 2.1 time: 0.167785 Sep 08 14:03:58.695587 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 267/531] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:58 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:58.905152 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1fbd4a2c-7a48-41f9-a9b9-43f5df4e619d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:58.905769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1fbd4a2c-7a48-41f9-a9b9-43f5df4e619d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:58.912352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1fbd4a2c-7a48-41f9-a9b9-43f5df4e619d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:58.912841 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1fbd4a2c-7a48-41f9-a9b9-43f5df4e619d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:58.913279 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1fbd4a2c-7a48-41f9-a9b9-43f5df4e619d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:58.913974 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1fbd4a2c-7a48-41f9-a9b9-43f5df4e619d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:58.914429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1fbd4a2c-7a48-41f9-a9b9-43f5df4e619d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:58.914862 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1fbd4a2c-7a48-41f9-a9b9-43f5df4e619d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:59.055503 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1fbd4a2c-7a48-41f9-a9b9-43f5df4e619d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:59.060670 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1fbd4a2c-7a48-41f9-a9b9-43f5df4e619d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1683 microversion: 2.1 time: 0.159354 Sep 08 14:03:59.061258 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 265/532] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:58 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:59.504211 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:59.504817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:59.510782 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:59.511294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:59.511724 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:59.512416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:59.512916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:59.513282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:59.675368 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:59.684323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:59.685659 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:59.686850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-382fe2ef-b599-4a12-8745-8e2cceb8954a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.187152 Sep 08 14:03:59.687443 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 268/533] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:03:59 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:03:59.718011 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5618f1a8-ed63-4b3d-993e-751e60ed6364 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:59.718599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5618f1a8-ed63-4b3d-993e-751e60ed6364 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:59.725689 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5618f1a8-ed63-4b3d-993e-751e60ed6364 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:59.726182 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5618f1a8-ed63-4b3d-993e-751e60ed6364 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:59.726618 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5618f1a8-ed63-4b3d-993e-751e60ed6364 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:59.727506 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5618f1a8-ed63-4b3d-993e-751e60ed6364 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:59.727970 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5618f1a8-ed63-4b3d-993e-751e60ed6364 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:59.728394 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5618f1a8-ed63-4b3d-993e-751e60ed6364 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:59.903571 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5618f1a8-ed63-4b3d-993e-751e60ed6364 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:59.923298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5618f1a8-ed63-4b3d-993e-751e60ed6364 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1679 microversion: 2.1 time: 0.207201 Sep 08 14:03:59.926719 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 266/534] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:59 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:00.088357 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-68443d7c-b86b-4ae1-af73-9584808cefb4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:00.089804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-68443d7c-b86b-4ae1-af73-9584808cefb4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:00.100351 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68443d7c-b86b-4ae1-af73-9584808cefb4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.101364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68443d7c-b86b-4ae1-af73-9584808cefb4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.101364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68443d7c-b86b-4ae1-af73-9584808cefb4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.102618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68443d7c-b86b-4ae1-af73-9584808cefb4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.103205 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68443d7c-b86b-4ae1-af73-9584808cefb4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.103641 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-68443d7c-b86b-4ae1-af73-9584808cefb4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.345347 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-68443d7c-b86b-4ae1-af73-9584808cefb4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:00.355488 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-68443d7c-b86b-4ae1-af73-9584808cefb4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1683 microversion: 2.1 time: 0.273349 Sep 08 14:04:00.370922 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 269/535] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:00 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1683 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:00.713521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:00.714467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:00.721628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.722312 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.722730 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.723549 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.724273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.724918 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.960548 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:00.960807 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-de6c0197-c6ca-4f22-9316-e3a9d7140269 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:00.961478 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-de6c0197-c6ca-4f22-9316-e3a9d7140269 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:00.973295 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:00.975261 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:00.976761 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-cc6ee778-78f8-4bd9-8aa1-72c849fc792b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.267695 Sep 08 14:04:00.991248 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-de6c0197-c6ca-4f22-9316-e3a9d7140269 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.991248 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-de6c0197-c6ca-4f22-9316-e3a9d7140269 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.991248 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-de6c0197-c6ca-4f22-9316-e3a9d7140269 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.991248 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-de6c0197-c6ca-4f22-9316-e3a9d7140269 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.991904 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-de6c0197-c6ca-4f22-9316-e3a9d7140269 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.991904 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-de6c0197-c6ca-4f22-9316-e3a9d7140269 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.997189 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 267/536] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:00 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:01.321770 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-91e3d2fe-0940-49fd-bd5e-a976960bbe7f req-8a2f644f-dcd5-44ab-9869-631a8eb4ae96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd10060-2469-49e3-a8c3-949a359181f8", "name": "network-vif-deleted", "tag": "5a142423-c154-4b43-a8f8-2a5d3c52910e"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:01.376884 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-91e3d2fe-0940-49fd-bd5e-a976960bbe7f req-8a2f644f-dcd5-44ab-9869-631a8eb4ae96 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:01.379089 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-91e3d2fe-0940-49fd-bd5e-a976960bbe7f req-8a2f644f-dcd5-44ab-9869-631a8eb4ae96 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:01.388998 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-91e3d2fe-0940-49fd-bd5e-a976960bbe7f req-8a2f644f-dcd5-44ab-9869-631a8eb4ae96 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:01.412051 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-91e3d2fe-0940-49fd-bd5e-a976960bbe7f req-8a2f644f-dcd5-44ab-9869-631a8eb4ae96 service nova] Creating event network-vif-deleted:5a142423-c154-4b43-a8f8-2a5d3c52910e for instance edd10060-2469-49e3-a8c3-949a359181f8 on hv-cinder-84773 Sep 08 14:04:01.420774 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-de6c0197-c6ca-4f22-9316-e3a9d7140269 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:01.426266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-91e3d2fe-0940-49fd-bd5e-a976960bbe7f req-8a2f644f-dcd5-44ab-9869-631a8eb4ae96 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118157 Sep 08 14:04:01.426950 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 268/537] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:04:01.436253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c3d3991b-63ea-4af1-a950-2c2d6501b835 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:01.437085 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c3d3991b-63ea-4af1-a950-2c2d6501b835 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:01.441702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-de6c0197-c6ca-4f22-9316-e3a9d7140269 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1679 microversion: 2.1 time: 0.490202 Sep 08 14:04:01.442968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 270/538] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:00 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1679 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:01.449801 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c3d3991b-63ea-4af1-a950-2c2d6501b835 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:01.450395 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c3d3991b-63ea-4af1-a950-2c2d6501b835 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:01.450963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c3d3991b-63ea-4af1-a950-2c2d6501b835 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:01.451753 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c3d3991b-63ea-4af1-a950-2c2d6501b835 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:01.455791 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c3d3991b-63ea-4af1-a950-2c2d6501b835 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:01.456477 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c3d3991b-63ea-4af1-a950-2c2d6501b835 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:01.552824 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c3d3991b-63ea-4af1-a950-2c2d6501b835 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:01.570595 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c3d3991b-63ea-4af1-a950-2c2d6501b835 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1615 microversion: 2.1 time: 0.138674 Sep 08 14:04:01.591352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 269/539] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:01 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1615 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:02.013432 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:02.013432 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:02.017226 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.017744 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.018554 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.019362 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.020033 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.020566 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.219755 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:02.232025 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:02.234012 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:02.236523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9421c1ea-064b-4f0f-8c4d-5d85245a4f34 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.233856 Sep 08 14:04:02.237555 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 271/540] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:02 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:02.474094 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-50787603-646e-409e-8e5a-79ab97792a8e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:02.488715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-50787603-646e-409e-8e5a-79ab97792a8e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:02.497628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50787603-646e-409e-8e5a-79ab97792a8e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.498160 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50787603-646e-409e-8e5a-79ab97792a8e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.498599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50787603-646e-409e-8e5a-79ab97792a8e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.499356 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50787603-646e-409e-8e5a-79ab97792a8e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.499810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50787603-646e-409e-8e5a-79ab97792a8e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.500991 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50787603-646e-409e-8e5a-79ab97792a8e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.599799 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0f834803-86bb-4889-92d6-957590df9da6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:02.600499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0f834803-86bb-4889-92d6-957590df9da6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:02.612746 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f834803-86bb-4889-92d6-957590df9da6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.613610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f834803-86bb-4889-92d6-957590df9da6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.617560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f834803-86bb-4889-92d6-957590df9da6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.620678 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f834803-86bb-4889-92d6-957590df9da6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.623649 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f834803-86bb-4889-92d6-957590df9da6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.625797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f834803-86bb-4889-92d6-957590df9da6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.667220 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-50787603-646e-409e-8e5a-79ab97792a8e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:02.684031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-50787603-646e-409e-8e5a-79ab97792a8e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1656 microversion: 2.1 time: 0.215758 Sep 08 14:04:02.702239 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 270/541] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:02 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1656 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:02.711019 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c008d0b6-2210-48a6-a1e6-63c44e12c616 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:02.733525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c008d0b6-2210-48a6-a1e6-63c44e12c616 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.735209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c008d0b6-2210-48a6-a1e6-63c44e12c616 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.735957 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c008d0b6-2210-48a6-a1e6-63c44e12c616 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.774339 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0f834803-86bb-4889-92d6-957590df9da6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:02.784552 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0f834803-86bb-4889-92d6-957590df9da6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1327 microversion: 2.1 time: 0.190552 Sep 08 14:04:02.802413 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 272/542] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:02 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1327 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:02.806452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c008d0b6-2210-48a6-a1e6-63c44e12c616 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Going to try to start instance {{(pid=133058) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 14:04:03.246089 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c008d0b6-2210-48a6-a1e6-63c44e12c616 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/action" status: 202 len: 0 microversion: 2.1 time: 0.541993 Sep 08 14:04:03.246853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 271/543] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:04:02 2022] POST /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:04:03.255509 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c0f3cbd6-d957-43fe-a7f2-84bdf7ed4191 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:03.256099 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c0f3cbd6-d957-43fe-a7f2-84bdf7ed4191 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:03.262688 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0f3cbd6-d957-43fe-a7f2-84bdf7ed4191 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:03.263221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0f3cbd6-d957-43fe-a7f2-84bdf7ed4191 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:03.263655 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0f3cbd6-d957-43fe-a7f2-84bdf7ed4191 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:03.269400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0f3cbd6-d957-43fe-a7f2-84bdf7ed4191 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:03.269400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0f3cbd6-d957-43fe-a7f2-84bdf7ed4191 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:03.269400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c0f3cbd6-d957-43fe-a7f2-84bdf7ed4191 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:03.272345 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:03.273065 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:03.284613 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:03.285346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:03.285939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:03.286940 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:03.294119 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:03.294777 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:03.449386 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c0f3cbd6-d957-43fe-a7f2-84bdf7ed4191 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:03.459748 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c0f3cbd6-d957-43fe-a7f2-84bdf7ed4191 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1665 microversion: 2.1 time: 0.208400 Sep 08 14:04:03.460836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 273/544] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:03 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1665 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:03.493412 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:03.507400 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:03.509255 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:03.510813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0b318a03-1af9-474e-be88-1ad77405ae11 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.242867 Sep 08 14:04:03.511956 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 272/545] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:03 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:03.825971 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ae19649b-2373-4db3-8292-85d58cf54c1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:03.831868 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ae19649b-2373-4db3-8292-85d58cf54c1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:03.851674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae19649b-2373-4db3-8292-85d58cf54c1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:03.852446 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae19649b-2373-4db3-8292-85d58cf54c1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:03.853051 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae19649b-2373-4db3-8292-85d58cf54c1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:03.853937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae19649b-2373-4db3-8292-85d58cf54c1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:03.854538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae19649b-2373-4db3-8292-85d58cf54c1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:03.855383 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae19649b-2373-4db3-8292-85d58cf54c1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:03.949539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ae19649b-2373-4db3-8292-85d58cf54c1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:03.959490 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ae19649b-2373-4db3-8292-85d58cf54c1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1327 microversion: 2.1 time: 0.147110 Sep 08 14:04:03.960172 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 274/546] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:03 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1327 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:04.491548 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-75bbfe4c-c8fc-4fb6-af2c-a95da0c73747 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:04.492156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-75bbfe4c-c8fc-4fb6-af2c-a95da0c73747 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:04.499139 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75bbfe4c-c8fc-4fb6-af2c-a95da0c73747 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:04.500957 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75bbfe4c-c8fc-4fb6-af2c-a95da0c73747 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:04.501561 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75bbfe4c-c8fc-4fb6-af2c-a95da0c73747 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:04.502467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75bbfe4c-c8fc-4fb6-af2c-a95da0c73747 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:04.503230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75bbfe4c-c8fc-4fb6-af2c-a95da0c73747 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:04.503889 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-75bbfe4c-c8fc-4fb6-af2c-a95da0c73747 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:04.520711 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:04.539362 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:04.539966 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:04.549051 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:04.549698 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:04.550113 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:04.552832 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:04.553312 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:04.553743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:04.658291 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-75bbfe4c-c8fc-4fb6-af2c-a95da0c73747 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:04.667467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-75bbfe4c-c8fc-4fb6-af2c-a95da0c73747 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1665 microversion: 2.1 time: 0.182477 Sep 08 14:04:04.670715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 273/547] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:04 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1665 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:04.757879 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:04.770558 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:04.772322 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:04.774097 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7f9b6627-673b-4669-9967-0e29526c5984 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.239110 Sep 08 14:04:04.774747 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 275/548] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:04 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:04:04.982348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-24e2efa8-3ba0-4740-aaa0-f319d76386b4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:04.983309 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-24e2efa8-3ba0-4740-aaa0-f319d76386b4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:04.994211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24e2efa8-3ba0-4740-aaa0-f319d76386b4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:04.994708 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24e2efa8-3ba0-4740-aaa0-f319d76386b4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:04.995533 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24e2efa8-3ba0-4740-aaa0-f319d76386b4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:04.996468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24e2efa8-3ba0-4740-aaa0-f319d76386b4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:04.996951 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24e2efa8-3ba0-4740-aaa0-f319d76386b4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:04.997425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24e2efa8-3ba0-4740-aaa0-f319d76386b4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:05.069471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-24e2efa8-3ba0-4740-aaa0-f319d76386b4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:05.079664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-24e2efa8-3ba0-4740-aaa0-f319d76386b4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1327 microversion: 2.1 time: 0.101350 Sep 08 14:04:05.080584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 274/549] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:04 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:05.693545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-43e41c88-f25a-4d4d-b6cb-d79968094d4e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:05.694203 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-43e41c88-f25a-4d4d-b6cb-d79968094d4e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:05.701634 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43e41c88-f25a-4d4d-b6cb-d79968094d4e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:05.702130 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43e41c88-f25a-4d4d-b6cb-d79968094d4e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:05.702594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43e41c88-f25a-4d4d-b6cb-d79968094d4e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:05.703942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43e41c88-f25a-4d4d-b6cb-d79968094d4e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:05.704485 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43e41c88-f25a-4d4d-b6cb-d79968094d4e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:05.704914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-43e41c88-f25a-4d4d-b6cb-d79968094d4e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:05.801779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:05.803111 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:05.810007 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:05.810704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:05.811193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:05.812147 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:05.813339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:05.813774 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:05.856463 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-43e41c88-f25a-4d4d-b6cb-d79968094d4e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:05.871972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-43e41c88-f25a-4d4d-b6cb-d79968094d4e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1665 microversion: 2.1 time: 0.182269 Sep 08 14:04:05.872821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 276/550] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:05 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1665 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:05.971857 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:05.982070 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:05.983575 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:05.993358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e4807035-40bd-4dd4-aa38-b2649f713e88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.187934 Sep 08 14:04:06.000054 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 275/551] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:05 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:06.104836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ab1df1b9-7207-4877-82dc-fd468a9dbe49 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:06.105560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ab1df1b9-7207-4877-82dc-fd468a9dbe49 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:06.112850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ab1df1b9-7207-4877-82dc-fd468a9dbe49 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:06.113675 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ab1df1b9-7207-4877-82dc-fd468a9dbe49 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:06.114511 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ab1df1b9-7207-4877-82dc-fd468a9dbe49 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:06.115270 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ab1df1b9-7207-4877-82dc-fd468a9dbe49 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:06.115790 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ab1df1b9-7207-4877-82dc-fd468a9dbe49 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:06.116287 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ab1df1b9-7207-4877-82dc-fd468a9dbe49 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:06.182844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ab1df1b9-7207-4877-82dc-fd468a9dbe49 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:06.191635 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ab1df1b9-7207-4877-82dc-fd468a9dbe49 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1327 microversion: 2.1 time: 0.090627 Sep 08 14:04:06.195075 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 277/552] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:06 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:06.903211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6a9584ab-da61-4344-b328-76fb066678bc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:06.904621 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6a9584ab-da61-4344-b328-76fb066678bc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:06.912612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a9584ab-da61-4344-b328-76fb066678bc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:06.913106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a9584ab-da61-4344-b328-76fb066678bc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:06.913536 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a9584ab-da61-4344-b328-76fb066678bc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:06.914232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a9584ab-da61-4344-b328-76fb066678bc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:06.914678 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a9584ab-da61-4344-b328-76fb066678bc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:06.915125 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6a9584ab-da61-4344-b328-76fb066678bc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:07.013061 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:07.014735 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:07.023450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:07.025685 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:07.025685 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:07.025685 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:07.026043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:07.026190 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:07.148346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6a9584ab-da61-4344-b328-76fb066678bc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:07.158335 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6a9584ab-da61-4344-b328-76fb066678bc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1665 microversion: 2.1 time: 0.265049 Sep 08 14:04:07.158956 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 276/553] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:06 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1665 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:07.217603 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-47192792-04d1-4a51-b0eb-dab33d8a4590 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:07.218460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-47192792-04d1-4a51-b0eb-dab33d8a4590 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:07.228999 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:07.236336 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47192792-04d1-4a51-b0eb-dab33d8a4590 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:07.237093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47192792-04d1-4a51-b0eb-dab33d8a4590 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:07.237708 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47192792-04d1-4a51-b0eb-dab33d8a4590 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:07.238583 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47192792-04d1-4a51-b0eb-dab33d8a4590 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:07.239218 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47192792-04d1-4a51-b0eb-dab33d8a4590 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:07.239841 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47192792-04d1-4a51-b0eb-dab33d8a4590 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:07.241082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:07.252425 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:07.254378 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c4d08ef0-baa7-4643-9f6f-d88ea54016cc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.245253 Sep 08 14:04:07.254682 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 278/554] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:07 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:07.317482 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-47192792-04d1-4a51-b0eb-dab33d8a4590 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:07.326780 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-47192792-04d1-4a51-b0eb-dab33d8a4590 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1327 microversion: 2.1 time: 0.114496 Sep 08 14:04:07.327646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 277/555] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:07 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:08.187603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-71062d84-8e59-44f7-9679-c48a314582e4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:08.188602 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-71062d84-8e59-44f7-9679-c48a314582e4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:08.196058 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71062d84-8e59-44f7-9679-c48a314582e4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:08.196832 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71062d84-8e59-44f7-9679-c48a314582e4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:08.197364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71062d84-8e59-44f7-9679-c48a314582e4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:08.198160 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71062d84-8e59-44f7-9679-c48a314582e4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:08.198772 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71062d84-8e59-44f7-9679-c48a314582e4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:08.199333 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-71062d84-8e59-44f7-9679-c48a314582e4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:08.281183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:08.282522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:08.289940 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:08.290425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:08.290859 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:08.291595 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:08.292048 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:08.292491 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:08.334569 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-71062d84-8e59-44f7-9679-c48a314582e4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:08.342546 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-71062d84-8e59-44f7-9679-c48a314582e4 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1665 microversion: 2.1 time: 0.160437 Sep 08 14:04:08.343176 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 279/556] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:08 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:08.359447 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:08.360142 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:08.366541 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:08.372390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:08.372390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:08.372390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:08.372390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:08.372789 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:08.402475 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:08.402872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:08.403382 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:08.403831 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lazy-loading 'fault' on Instance uuid edd10060-2469-49e3-a8c3-949a359181f8 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:04:08.441168 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:08.445094 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:08.446544 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:08.447843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0f008e32-948c-4d21-b6ee-155fbe00cc64 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.170717 Sep 08 14:04:08.450939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 278/557] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:08 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:04:08.451424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:08.460494 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2e315def-9d0b-42f2-bc03-4fe5887a56db tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1332 microversion: 2.1 time: 0.112170 Sep 08 14:04:08.461140 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 280/558] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:08 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:09.369853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-830125d0-de8f-47bb-bba0-49d13bba477e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:09.370971 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-830125d0-de8f-47bb-bba0-49d13bba477e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:09.381564 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-830125d0-de8f-47bb-bba0-49d13bba477e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:09.382393 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-830125d0-de8f-47bb-bba0-49d13bba477e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:09.383201 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-830125d0-de8f-47bb-bba0-49d13bba477e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:09.384431 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-830125d0-de8f-47bb-bba0-49d13bba477e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:09.385243 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-830125d0-de8f-47bb-bba0-49d13bba477e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:09.385995 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-830125d0-de8f-47bb-bba0-49d13bba477e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:09.477480 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:09.477480 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:09.483398 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:09.484060 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:09.485256 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:09.486617 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:09.487307 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:09.487978 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:09.530839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-830125d0-de8f-47bb-bba0-49d13bba477e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:09.539654 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-830125d0-de8f-47bb-bba0-49d13bba477e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1665 microversion: 2.1 time: 0.176657 Sep 08 14:04:09.540239 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 279/559] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:09 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1665 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:09.544675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:09.545285 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:09.552103 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:09.552582 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:09.553018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:09.553769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:09.554225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:09.554643 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:09.587012 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:09.587503 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:09.587943 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:09.588417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lazy-loading 'fault' on Instance uuid edd10060-2469-49e3-a8c3-949a359181f8 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:04:09.628196 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:09.636741 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:09.637762 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:09.639655 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:09.641048 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a09fc212-b1a2-4082-95d8-3f7215e59713 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.171083 Sep 08 14:04:09.641853 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 281/560] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:09 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:04:09.645477 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b26e8883-6c31-42ed-b513-8ccf47e22178 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 200 len: 1332 microversion: 2.1 time: 0.104210 Sep 08 14:04:09.647982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 280/561] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:09 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:10.403292 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f7cd8dda-d4dc-4f6d-ac0b-30619a53f6af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:10.405773 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f7cd8dda-d4dc-4f6d-ac0b-30619a53f6af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:10.412844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7cd8dda-d4dc-4f6d-ac0b-30619a53f6af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:10.413348 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7cd8dda-d4dc-4f6d-ac0b-30619a53f6af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:10.413785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7cd8dda-d4dc-4f6d-ac0b-30619a53f6af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.414509 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7cd8dda-d4dc-4f6d-ac0b-30619a53f6af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:10.414996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7cd8dda-d4dc-4f6d-ac0b-30619a53f6af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:10.415423 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7cd8dda-d4dc-4f6d-ac0b-30619a53f6af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.439922 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-f7cd8dda-d4dc-4f6d-ac0b-30619a53f6af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lazy-loading 'flavor' on Instance uuid 4a905c87-01a3-4760-8c5c-7df6b9b7b190 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:04:10.564916 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-84661b42-ca11-486d-8063-26dbbeb7aa20 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:10.565611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-84661b42-ca11-486d-8063-26dbbeb7aa20 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:10.572692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-84661b42-ca11-486d-8063-26dbbeb7aa20 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:10.583813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-84661b42-ca11-486d-8063-26dbbeb7aa20 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:10.583813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-84661b42-ca11-486d-8063-26dbbeb7aa20 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.583813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-84661b42-ca11-486d-8063-26dbbeb7aa20 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:10.583813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-84661b42-ca11-486d-8063-26dbbeb7aa20 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:10.584419 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-84661b42-ca11-486d-8063-26dbbeb7aa20 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.606255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:10.723543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-84661b42-ca11-486d-8063-26dbbeb7aa20 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:10.732199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-84661b42-ca11-486d-8063-26dbbeb7aa20 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1665 microversion: 2.1 time: 0.172302 Sep 08 14:04:10.740537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 281/562] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:10 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1665 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:10.740537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:10.740537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:10.746102 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:10.746102 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:10.746102 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.746550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:10.746931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:10.747361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.814819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f7cd8dda-d4dc-4f6d-ac0b-30619a53f6af tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/action" status: 200 len: 32 microversion: 2.1 time: 0.415683 Sep 08 14:04:10.820385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 282/563] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:04:10 2022] POST /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/action => generated 32 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:04:10.826004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:10.826717 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:10.834588 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:10.835184 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:10.836011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.836885 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:10.837348 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:10.837773 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.853557 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 HTTP/1.1 Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:04:10.855280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:04:10.857126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': 'edd10060-2469-49e3-a8c3-949a359181f8'} Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:04:10.858001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:04:10.860876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:04:10.862728 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:04:10.862728 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6ca79710-c7ed-4adf-9553-e78c6430736f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 404 len: 111 microversion: 2.1 time: 0.034971 Sep 08 14:04:10.862728 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 283/564] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:10 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:04:10.862728 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b9d31d0a-c540-4ca4-85cc-559353b7ccf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:10.862728 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b9d31d0a-c540-4ca4-85cc-559353b7ccf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:10.869506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b9d31d0a-c540-4ca4-85cc-559353b7ccf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:10.869997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b9d31d0a-c540-4ca4-85cc-559353b7ccf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:10.870502 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b9d31d0a-c540-4ca4-85cc-559353b7ccf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.871223 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b9d31d0a-c540-4ca4-85cc-559353b7ccf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:10.871613 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b9d31d0a-c540-4ca4-85cc-559353b7ccf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:10.878222 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b9d31d0a-c540-4ca4-85cc-559353b7ccf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.897691 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:10.907441 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:10.909003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:10.910274 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-60742159-5a43-4ce1-ab90-bfa251d42533 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.176403 Sep 08 14:04:10.910823 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 282/565] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:10 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:10.915292 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-052c771f-1b17-4f1c-8640-ef817004e6ec tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '.version_select at 0x7f51fbf0eee0>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:11.018093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-052c771f-1b17-4f1c-8640-ef817004e6ec tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159232242" status: 202 len: 0 microversion: 2.1 time: 0.106040 Sep 08 14:04:11.023761 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b9d31d0a-c540-4ca4-85cc-559353b7ccf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:11.024351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 283/566] 10.222.0.91 () {58 vars in 1221 bytes} [Thu Sep 8 14:04:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159232242 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:04:11.030003 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b9d31d0a-c540-4ca4-85cc-559353b7ccf0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.171706 Sep 08 14:04:11.030622 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 284/567] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:10 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:11.444924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-39e3b662-fa88-4b83-99d4-8a338d55ad02 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:11.448797 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-39e3b662-fa88-4b83-99d4-8a338d55ad02 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:11.457184 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39e3b662-fa88-4b83-99d4-8a338d55ad02 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.457887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39e3b662-fa88-4b83-99d4-8a338d55ad02 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.458430 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39e3b662-fa88-4b83-99d4-8a338d55ad02 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:11.459312 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39e3b662-fa88-4b83-99d4-8a338d55ad02 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.459873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39e3b662-fa88-4b83-99d4-8a338d55ad02 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.460391 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-39e3b662-fa88-4b83-99d4-8a338d55ad02 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:11.677762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-39e3b662-fa88-4b83-99d4-8a338d55ad02 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "POST /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/action" status: 202 len: 0 microversion: 2.1 time: 0.236873 Sep 08 14:04:11.678922 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 284/568] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:04:11 2022] POST /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:04:11.686757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-76882e28-22c5-4bbd-81c0-7db97c033c55 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:11.690194 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-76882e28-22c5-4bbd-81c0-7db97c033c55 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:11.694777 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-76882e28-22c5-4bbd-81c0-7db97c033c55 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.695416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-76882e28-22c5-4bbd-81c0-7db97c033c55 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.696180 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-76882e28-22c5-4bbd-81c0-7db97c033c55 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:11.696731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-76882e28-22c5-4bbd-81c0-7db97c033c55 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.697261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-76882e28-22c5-4bbd-81c0-7db97c033c55 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.697749 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-76882e28-22c5-4bbd-81c0-7db97c033c55 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:11.759076 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b6f401f9-d5c5-48f9-8fff-d6e7dccc6d41 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:11.759424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b6f401f9-d5c5-48f9-8fff-d6e7dccc6d41 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:11.766983 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b6f401f9-d5c5-48f9-8fff-d6e7dccc6d41 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.767474 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b6f401f9-d5c5-48f9-8fff-d6e7dccc6d41 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.767944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b6f401f9-d5c5-48f9-8fff-d6e7dccc6d41 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:11.768657 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b6f401f9-d5c5-48f9-8fff-d6e7dccc6d41 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.769111 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b6f401f9-d5c5-48f9-8fff-d6e7dccc6d41 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.769538 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b6f401f9-d5c5-48f9-8fff-d6e7dccc6d41 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:11.923135 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b6f401f9-d5c5-48f9-8fff-d6e7dccc6d41 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:11.931729 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b6f401f9-d5c5-48f9-8fff-d6e7dccc6d41 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1669 microversion: 2.1 time: 0.177937 Sep 08 14:04:11.932350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 285/569] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:11 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1669 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:11.946039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:11.946835 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:11.954137 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.954621 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.955076 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:11.955812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.956261 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.956678 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:12.135761 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:12.147165 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:12.148791 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:12.150514 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5c211821-f266-4347-82ce-5886e6820268 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.208460 Sep 08 14:04:12.151058 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 286/570] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:11 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:12.157731 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-eb2613e3-21f8-44ba-b0bb-36816ac3b222 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:12.157731 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-eb2613e3-21f8-44ba-b0bb-36816ac3b222 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:12.165238 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb2613e3-21f8-44ba-b0bb-36816ac3b222 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:12.165740 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb2613e3-21f8-44ba-b0bb-36816ac3b222 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:12.166182 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb2613e3-21f8-44ba-b0bb-36816ac3b222 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:12.166922 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb2613e3-21f8-44ba-b0bb-36816ac3b222 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:12.167523 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb2613e3-21f8-44ba-b0bb-36816ac3b222 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:12.167958 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eb2613e3-21f8-44ba-b0bb-36816ac3b222 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:12.317672 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-eb2613e3-21f8-44ba-b0bb-36816ac3b222 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:12.331020 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-76882e28-22c5-4bbd-81c0-7db97c033c55 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:12.331262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-eb2613e3-21f8-44ba-b0bb-36816ac3b222 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.174890 Sep 08 14:04:12.331262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 287/571] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:12 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:12.340716 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-76882e28-22c5-4bbd-81c0-7db97c033c55 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1753 microversion: 2.1 time: 0.657639 Sep 08 14:04:12.341630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 285/572] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:11 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1753 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:12.508902 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-45efa203-ef38-46f6-a7ec-007e844efd8a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: .version_select at 0x7f51fbe834c0>, body: {"keypair": {"name": "tempest-keypair-1824373260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrFzjo/DE3kl5ikbdLA7XDuCBxWNQiQaGmi8chXDjHFJBlyiJTmdQl6cK+8bJ8r1u1lI36QRNU2+AiJsTcgE7UTmHahMACarWDwvgpSf3LbOSXiaC6FF7JGQhbPK//k8Q=="}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:12.526609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-45efa203-ef38-46f6-a7ec-007e844efd8a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:12.531463 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-45efa203-ef38-46f6-a7ec-007e844efd8a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for user beb41eb66e8140a6999b0bddab3c4afd and project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:12.615396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-45efa203-ef38-46f6-a7ec-007e844efd8a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110262 Sep 08 14:04:12.616029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 288/573] 10.222.0.91 () {60 vars in 1159 bytes} [Thu Sep 8 14:04:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:13.178612 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:13.179318 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:13.186252 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:13.186804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:13.187210 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:13.187962 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:13.188409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:13.188841 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:13.340060 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:13.350317 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:13.351794 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:13.352964 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b1b7bc14-bbc1-493c-8505-0490b514403b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.179183 Sep 08 14:04:13.355107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 286/574] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:13 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:04:13.360335 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-eafd353d-33d2-4359-b165-4d9a25e1d6d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:13.361045 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-eafd353d-33d2-4359-b165-4d9a25e1d6d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:13.365859 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-26a0c5a0-ba18-4b62-a9ad-7ae4f8e6f632 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:13.366914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-26a0c5a0-ba18-4b62-a9ad-7ae4f8e6f632 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:13.368398 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eafd353d-33d2-4359-b165-4d9a25e1d6d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:13.368951 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eafd353d-33d2-4359-b165-4d9a25e1d6d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:13.369393 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eafd353d-33d2-4359-b165-4d9a25e1d6d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:13.370099 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eafd353d-33d2-4359-b165-4d9a25e1d6d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:13.370828 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eafd353d-33d2-4359-b165-4d9a25e1d6d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:13.371315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-eafd353d-33d2-4359-b165-4d9a25e1d6d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:13.374371 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26a0c5a0-ba18-4b62-a9ad-7ae4f8e6f632 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:13.375391 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26a0c5a0-ba18-4b62-a9ad-7ae4f8e6f632 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:13.376996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26a0c5a0-ba18-4b62-a9ad-7ae4f8e6f632 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:13.376996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26a0c5a0-ba18-4b62-a9ad-7ae4f8e6f632 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:13.376996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26a0c5a0-ba18-4b62-a9ad-7ae4f8e6f632 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:13.377398 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-26a0c5a0-ba18-4b62-a9ad-7ae4f8e6f632 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:13.558075 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-26a0c5a0-ba18-4b62-a9ad-7ae4f8e6f632 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:13.562002 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-eafd353d-33d2-4359-b165-4d9a25e1d6d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:13.567284 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-26a0c5a0-ba18-4b62-a9ad-7ae4f8e6f632 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1753 microversion: 2.1 time: 0.206227 Sep 08 14:04:13.567876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 287/575] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:13 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:13.570865 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-eafd353d-33d2-4359-b165-4d9a25e1d6d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.214659 Sep 08 14:04:13.571536 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 289/576] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:13 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:14.386406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:14.386979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:14.394218 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:14.394716 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:14.395180 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:14.395892 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:14.396490 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:14.396927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:14.545809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:14.558164 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:14.559929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:14.561449 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-37d40fb0-f885-4333-b38b-a23cb21d1e5c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.181863 Sep 08 14:04:14.574922 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 288/577] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:14 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:14.592198 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8e5ddf33-37f6-4db2-b1e6-1f95a33ea90f tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:14.593491 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8e5ddf33-37f6-4db2-b1e6-1f95a33ea90f tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:14.596264 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0a185519-c647-49b4-8ac7-07f029d959fb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:14.596983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0a185519-c647-49b4-8ac7-07f029d959fb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:14.600616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8e5ddf33-37f6-4db2-b1e6-1f95a33ea90f tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:14.601702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8e5ddf33-37f6-4db2-b1e6-1f95a33ea90f tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:14.601941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8e5ddf33-37f6-4db2-b1e6-1f95a33ea90f tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:14.602974 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8e5ddf33-37f6-4db2-b1e6-1f95a33ea90f tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:14.603660 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8e5ddf33-37f6-4db2-b1e6-1f95a33ea90f tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:14.604049 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0a185519-c647-49b4-8ac7-07f029d959fb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:14.604319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8e5ddf33-37f6-4db2-b1e6-1f95a33ea90f tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:14.604926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0a185519-c647-49b4-8ac7-07f029d959fb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:14.605367 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0a185519-c647-49b4-8ac7-07f029d959fb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:14.606345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0a185519-c647-49b4-8ac7-07f029d959fb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:14.606813 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0a185519-c647-49b4-8ac7-07f029d959fb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:14.607486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0a185519-c647-49b4-8ac7-07f029d959fb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:14.628297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:14.768845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0a185519-c647-49b4-8ac7-07f029d959fb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:14.778069 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0a185519-c647-49b4-8ac7-07f029d959fb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.186480 Sep 08 14:04:14.778219 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8e5ddf33-37f6-4db2-b1e6-1f95a33ea90f tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:14.778667 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 289/578] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:14 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:14.786964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8e5ddf33-37f6-4db2-b1e6-1f95a33ea90f tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1758 microversion: 2.1 time: 0.198936 Sep 08 14:04:14.787549 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 290/579] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:14 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:15.339185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2010468415", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38509184-249f-4b78-9ab0-339bc3caa638"}], "security_groups": [{"name": "tempest-securitygroup--1759839506"}], "key_name": "tempest-keypair-1824373260", "user_data": "}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:15.453120 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] validate_networks() for [('38509184-249f-4b78-9ab0-339bc3caa638', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:04:15.594179 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:15.595349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:15.608502 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:15.609961 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:15.610634 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.611715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:15.612305 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:15.612746 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.802087 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:15.814350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:15.815910 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:15.817145 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e5fd2015-63e9-43c0-9904-c58a265c09d6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.230562 Sep 08 14:04:15.817741 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 291/580] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:15 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:04:15.823034 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-097a484f-8d5c-4598-83aa-6e65118a1158 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:15.823881 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-097a484f-8d5c-4598-83aa-6e65118a1158 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:15.825947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:15.831869 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-097a484f-8d5c-4598-83aa-6e65118a1158 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:15.832607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-097a484f-8d5c-4598-83aa-6e65118a1158 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:15.833242 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-097a484f-8d5c-4598-83aa-6e65118a1158 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.834173 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-097a484f-8d5c-4598-83aa-6e65118a1158 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:15.834840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-097a484f-8d5c-4598-83aa-6e65118a1158 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:15.835455 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-097a484f-8d5c-4598-83aa-6e65118a1158 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.937125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:04:15.938083 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:04:15.938568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:04:15.939204 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:04:15.939621 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:04:15.949167 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:15.949657 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:15.950098 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.951112 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:15.951576 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:15.952012 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.970510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:15.974974 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for user beb41eb66e8140a6999b0bddab3c4afd and project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:15.990511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-097a484f-8d5c-4598-83aa-6e65118a1158 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:15.993187 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:04:15.995589 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:04:15.999197 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-097a484f-8d5c-4598-83aa-6e65118a1158 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.179703 Sep 08 14:04:15.999568 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 292/581] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:15 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:16.005591 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e62e004d-503e-4bd3-920f-61179cb5d8b6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:16.006187 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e62e004d-503e-4bd3-920f-61179cb5d8b6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:16.013030 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62e004d-503e-4bd3-920f-61179cb5d8b6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:16.016101 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62e004d-503e-4bd3-920f-61179cb5d8b6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:16.016101 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62e004d-503e-4bd3-920f-61179cb5d8b6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:16.016101 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62e004d-503e-4bd3-920f-61179cb5d8b6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:16.016101 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62e004d-503e-4bd3-920f-61179cb5d8b6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:16.016668 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62e004d-503e-4bd3-920f-61179cb5d8b6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:16.150347 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0238120d-daa2-4474-9d56-e7b7433295f9 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.815646 Sep 08 14:04:16.151158 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 290/582] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:04:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:04:16.164952 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5888e69e-6fab-4b36-8b9c-64c61ee507e1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:16.165645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5888e69e-6fab-4b36-8b9c-64c61ee507e1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:16.197402 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e62e004d-503e-4bd3-920f-61179cb5d8b6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:16.206668 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e62e004d-503e-4bd3-920f-61179cb5d8b6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1758 microversion: 2.1 time: 0.205325 Sep 08 14:04:16.207504 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 293/583] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:15 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1758 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:16.231633 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5888e69e-6fab-4b36-8b9c-64c61ee507e1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:16.239471 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5888e69e-6fab-4b36-8b9c-64c61ee507e1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1242 microversion: 2.1 time: 0.079000 Sep 08 14:04:16.240281 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 291/584] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:16 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:16.843507 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:16.844146 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:16.850756 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:16.851263 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:16.851698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:16.852384 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:16.852839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:16.853259 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:16.984303 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:16.993278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:16.994734 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:16.995931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7e12e25b-3ba7-4c8f-8409-80ea768fcf94 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.156484 Sep 08 14:04:16.996489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 294/585] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:16 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:17.024646 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2fd70181-93f5-44d6-803e-45dd3eb5165d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:17.025377 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2fd70181-93f5-44d6-803e-45dd3eb5165d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:17.032659 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2fd70181-93f5-44d6-803e-45dd3eb5165d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:17.033142 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2fd70181-93f5-44d6-803e-45dd3eb5165d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:17.033574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2fd70181-93f5-44d6-803e-45dd3eb5165d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:17.034264 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2fd70181-93f5-44d6-803e-45dd3eb5165d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:17.034712 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2fd70181-93f5-44d6-803e-45dd3eb5165d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:17.035168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2fd70181-93f5-44d6-803e-45dd3eb5165d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:17.178666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2fd70181-93f5-44d6-803e-45dd3eb5165d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:17.187239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2fd70181-93f5-44d6-803e-45dd3eb5165d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.166622 Sep 08 14:04:17.190165 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 292/586] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:17 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:17.231251 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0401060e-0219-4e1f-8318-9dd4197dee76 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:17.231815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0401060e-0219-4e1f-8318-9dd4197dee76 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:17.238540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0401060e-0219-4e1f-8318-9dd4197dee76 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:17.239054 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0401060e-0219-4e1f-8318-9dd4197dee76 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:17.239491 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0401060e-0219-4e1f-8318-9dd4197dee76 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:17.242798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0401060e-0219-4e1f-8318-9dd4197dee76 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:17.242798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0401060e-0219-4e1f-8318-9dd4197dee76 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:17.242798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0401060e-0219-4e1f-8318-9dd4197dee76 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:17.261819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ebe86303-74a6-47b8-86b9-509f52add753 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:17.266512 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ebe86303-74a6-47b8-86b9-509f52add753 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:17.268582 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe86303-74a6-47b8-86b9-509f52add753 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:17.269062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe86303-74a6-47b8-86b9-509f52add753 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:17.269491 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe86303-74a6-47b8-86b9-509f52add753 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:17.270185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe86303-74a6-47b8-86b9-509f52add753 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:17.270728 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe86303-74a6-47b8-86b9-509f52add753 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:17.271184 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ebe86303-74a6-47b8-86b9-509f52add753 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:17.340364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ebe86303-74a6-47b8-86b9-509f52add753 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:17.348338 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ebe86303-74a6-47b8-86b9-509f52add753 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1246 microversion: 2.1 time: 0.090387 Sep 08 14:04:17.349113 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 293/587] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:17 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:17.401548 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0401060e-0219-4e1f-8318-9dd4197dee76 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:17.410534 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0401060e-0219-4e1f-8318-9dd4197dee76 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1758 microversion: 2.1 time: 0.183312 Sep 08 14:04:17.411140 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 295/588] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:17 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:18.024102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:18.024969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:18.032827 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:18.033306 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:18.033730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:18.034415 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:18.034859 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:18.035306 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:18.176421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:18.184360 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:18.185835 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:18.187261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-972f265a-ddc1-4aae-92cf-e48193ed5dc6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.168648 Sep 08 14:04:18.187857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 294/589] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:18 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:18.212702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-38a9c626-325b-4d37-9132-bb76936d6b31 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:18.213313 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-38a9c626-325b-4d37-9132-bb76936d6b31 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:18.220483 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-38a9c626-325b-4d37-9132-bb76936d6b31 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:18.220970 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-38a9c626-325b-4d37-9132-bb76936d6b31 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:18.221403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-38a9c626-325b-4d37-9132-bb76936d6b31 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:18.222097 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-38a9c626-325b-4d37-9132-bb76936d6b31 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:18.222544 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-38a9c626-325b-4d37-9132-bb76936d6b31 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:18.223005 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-38a9c626-325b-4d37-9132-bb76936d6b31 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:18.366067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-38a9c626-325b-4d37-9132-bb76936d6b31 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:18.371824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-bbde01f0-5ed8-4566-9162-c01e1f1f9e28 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:18.372688 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-bbde01f0-5ed8-4566-9162-c01e1f1f9e28 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:18.375309 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-38a9c626-325b-4d37-9132-bb76936d6b31 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.165938 Sep 08 14:04:18.375910 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 296/590] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:18 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:18.379514 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbde01f0-5ed8-4566-9162-c01e1f1f9e28 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:18.380006 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbde01f0-5ed8-4566-9162-c01e1f1f9e28 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:18.380442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbde01f0-5ed8-4566-9162-c01e1f1f9e28 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:18.381145 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbde01f0-5ed8-4566-9162-c01e1f1f9e28 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:18.381601 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbde01f0-5ed8-4566-9162-c01e1f1f9e28 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:18.382059 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbde01f0-5ed8-4566-9162-c01e1f1f9e28 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:18.434578 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-36c7c474-1b18-4435-9f80-eb5404310619 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:18.435222 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-36c7c474-1b18-4435-9f80-eb5404310619 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:18.441836 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-36c7c474-1b18-4435-9f80-eb5404310619 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:18.442308 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-36c7c474-1b18-4435-9f80-eb5404310619 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:18.442735 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-36c7c474-1b18-4435-9f80-eb5404310619 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:18.443815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-36c7c474-1b18-4435-9f80-eb5404310619 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:18.444272 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-36c7c474-1b18-4435-9f80-eb5404310619 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:18.444690 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-36c7c474-1b18-4435-9f80-eb5404310619 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:18.451675 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-bbde01f0-5ed8-4566-9162-c01e1f1f9e28 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:18.462011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-bbde01f0-5ed8-4566-9162-c01e1f1f9e28 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1294 microversion: 2.1 time: 0.093989 Sep 08 14:04:18.463004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 295/591] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:18 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:18.607692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-36c7c474-1b18-4435-9f80-eb5404310619 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:18.617161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-36c7c474-1b18-4435-9f80-eb5404310619 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1758 microversion: 2.1 time: 0.186361 Sep 08 14:04:18.628319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 297/592] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:18 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:19.213631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:19.215059 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:19.221513 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.221990 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.222461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.223307 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.223757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.224186 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.389952 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:19.400251 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e0d7492f-3c6c-409a-97bc-017759868a61 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:19.401113 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e0d7492f-3c6c-409a-97bc-017759868a61 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:19.407796 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e0d7492f-3c6c-409a-97bc-017759868a61 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.408385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e0d7492f-3c6c-409a-97bc-017759868a61 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.408897 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e0d7492f-3c6c-409a-97bc-017759868a61 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.409273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:19.409768 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e0d7492f-3c6c-409a-97bc-017759868a61 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.410317 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e0d7492f-3c6c-409a-97bc-017759868a61 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.410813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e0d7492f-3c6c-409a-97bc-017759868a61 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.410967 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:19.412181 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7d8173cb-bf33-481b-ac1b-a7ecfdac51dc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.202592 Sep 08 14:04:19.412737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 296/593] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:19 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:19.491149 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-36c1cf66-f186-4011-8101-efe2a5a95870 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:19.492140 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-36c1cf66-f186-4011-8101-efe2a5a95870 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:19.498601 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-36c1cf66-f186-4011-8101-efe2a5a95870 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.499380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-36c1cf66-f186-4011-8101-efe2a5a95870 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.500650 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-36c1cf66-f186-4011-8101-efe2a5a95870 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.501571 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-36c1cf66-f186-4011-8101-efe2a5a95870 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.502207 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-36c1cf66-f186-4011-8101-efe2a5a95870 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.502805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-36c1cf66-f186-4011-8101-efe2a5a95870 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.560396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e0d7492f-3c6c-409a-97bc-017759868a61 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:19.569545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e0d7492f-3c6c-409a-97bc-017759868a61 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.173631 Sep 08 14:04:19.570127 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 298/594] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:19 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:19.586777 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-36c1cf66-f186-4011-8101-efe2a5a95870 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:19.594560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-36c1cf66-f186-4011-8101-efe2a5a95870 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1300 microversion: 2.1 time: 0.107675 Sep 08 14:04:19.595189 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 297/595] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:19 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:19.644128 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ea1fe052-48e4-4f81-9c03-a8f89747e499 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:19.644735 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ea1fe052-48e4-4f81-9c03-a8f89747e499 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:19.651367 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ea1fe052-48e4-4f81-9c03-a8f89747e499 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.651850 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ea1fe052-48e4-4f81-9c03-a8f89747e499 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.652276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ea1fe052-48e4-4f81-9c03-a8f89747e499 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.652968 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ea1fe052-48e4-4f81-9c03-a8f89747e499 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.653405 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ea1fe052-48e4-4f81-9c03-a8f89747e499 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.654016 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ea1fe052-48e4-4f81-9c03-a8f89747e499 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.813056 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ea1fe052-48e4-4f81-9c03-a8f89747e499 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:19.821493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ea1fe052-48e4-4f81-9c03-a8f89747e499 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1758 microversion: 2.1 time: 0.181264 Sep 08 14:04:19.822076 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 299/596] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:19 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:19.940241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-adf28af9-3dd4-45e5-82e2-bdb90823098b req-e51193e6-3702-4c49-81b2-1cde912106dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ba16ca-2c31-48e8-853e-416c2c3bf1fd", "name": "network-vif-plugged", "status": "completed", "tag": "e0a16b6f-cb62-4645-9c10-fa91d5e04946"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:19.951750 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-adf28af9-3dd4-45e5-82e2-bdb90823098b req-e51193e6-3702-4c49-81b2-1cde912106dc service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.959533 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-adf28af9-3dd4-45e5-82e2-bdb90823098b req-e51193e6-3702-4c49-81b2-1cde912106dc service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.959533 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-adf28af9-3dd4-45e5-82e2-bdb90823098b req-e51193e6-3702-4c49-81b2-1cde912106dc service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.970510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-adf28af9-3dd4-45e5-82e2-bdb90823098b req-e51193e6-3702-4c49-81b2-1cde912106dc service nova] Creating event network-vif-plugged:e0a16b6f-cb62-4645-9c10-fa91d5e04946 for instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd on hv-cinder-84773 Sep 08 14:04:19.979494 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-adf28af9-3dd4-45e5-82e2-bdb90823098b req-e51193e6-3702-4c49-81b2-1cde912106dc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042533 Sep 08 14:04:19.986561 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 298/597] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:20.438821 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:20.439484 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:20.446495 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.447013 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.447452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.448143 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.448597 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.449052 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.594865 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-471bf40c-fbcd-4f15-ac90-f8163a3db711 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:20.595580 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-471bf40c-fbcd-4f15-ac90-f8163a3db711 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:20.603206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-471bf40c-fbcd-4f15-ac90-f8163a3db711 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.604331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-471bf40c-fbcd-4f15-ac90-f8163a3db711 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.604977 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-471bf40c-fbcd-4f15-ac90-f8163a3db711 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.605864 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-471bf40c-fbcd-4f15-ac90-f8163a3db711 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.606324 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-471bf40c-fbcd-4f15-ac90-f8163a3db711 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.606749 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-471bf40c-fbcd-4f15-ac90-f8163a3db711 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.612210 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:20.632576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:20.634283 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:20.635121 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8ebacd90-941b-4cf8-afad-d4d78e2d0de8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.200324 Sep 08 14:04:20.635721 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 300/598] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:20 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:20.656565 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c7dce6e2-7fef-4a9d-b377-9302865dd956 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:20.656565 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c7dce6e2-7fef-4a9d-b377-9302865dd956 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:20.661654 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c7dce6e2-7fef-4a9d-b377-9302865dd956 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.662148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c7dce6e2-7fef-4a9d-b377-9302865dd956 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.662642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c7dce6e2-7fef-4a9d-b377-9302865dd956 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.663669 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c7dce6e2-7fef-4a9d-b377-9302865dd956 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.664124 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c7dce6e2-7fef-4a9d-b377-9302865dd956 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.664546 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c7dce6e2-7fef-4a9d-b377-9302865dd956 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.813864 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c7dce6e2-7fef-4a9d-b377-9302865dd956 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:20.822064 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c7dce6e2-7fef-4a9d-b377-9302865dd956 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1368 microversion: 2.1 time: 0.185349 Sep 08 14:04:20.822641 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 301/599] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:20 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:20.847144 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ad7f96e0-3b93-47d6-91c6-6d476c8f61d5 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:20.848114 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ad7f96e0-3b93-47d6-91c6-6d476c8f61d5 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:20.856059 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad7f96e0-3b93-47d6-91c6-6d476c8f61d5 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.856773 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad7f96e0-3b93-47d6-91c6-6d476c8f61d5 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.857381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad7f96e0-3b93-47d6-91c6-6d476c8f61d5 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.858219 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad7f96e0-3b93-47d6-91c6-6d476c8f61d5 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.859024 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad7f96e0-3b93-47d6-91c6-6d476c8f61d5 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.859676 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad7f96e0-3b93-47d6-91c6-6d476c8f61d5 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.911435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-471bf40c-fbcd-4f15-ac90-f8163a3db711 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:20.920110 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-471bf40c-fbcd-4f15-ac90-f8163a3db711 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.330266 Sep 08 14:04:20.921068 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 299/600] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:20 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:21.023573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ad7f96e0-3b93-47d6-91c6-6d476c8f61d5 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:21.033404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ad7f96e0-3b93-47d6-91c6-6d476c8f61d5 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1758 microversion: 2.1 time: 0.191401 Sep 08 14:04:21.034118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 302/601] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:20 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:21.067837 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-c1256bc8-200d-4c0e-a92a-bdbca79c4906 req-130e4295-a09d-4761-87ae-afdfa1a82030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "789dd836-53d0-47a2-99a0-543e2997ad11", "tag": "bd2176c3-7d91-4643-8017-87305f438b36"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:21.072964 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:21.078251 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-c1256bc8-200d-4c0e-a92a-bdbca79c4906 req-130e4295-a09d-4761-87ae-afdfa1a82030 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:21.078696 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-c1256bc8-200d-4c0e-a92a-bdbca79c4906 req-130e4295-a09d-4761-87ae-afdfa1a82030 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:21.079153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-c1256bc8-200d-4c0e-a92a-bdbca79c4906 req-130e4295-a09d-4761-87ae-afdfa1a82030 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:21.090922 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-c1256bc8-200d-4c0e-a92a-bdbca79c4906 req-130e4295-a09d-4761-87ae-afdfa1a82030 service nova] Creating event network-changed:bd2176c3-7d91-4643-8017-87305f438b36 for instance 789dd836-53d0-47a2-99a0-543e2997ad11 on hv-cinder-84773 Sep 08 14:04:21.095831 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-c1256bc8-200d-4c0e-a92a-bdbca79c4906 req-130e4295-a09d-4761-87ae-afdfa1a82030 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031756 Sep 08 14:04:21.097260 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 300/602] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:21.664022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:21.664616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:21.671317 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:21.672524 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:21.672968 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:21.673702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:21.674158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:21.674584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:21.826653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:21.835963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:21.837520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:21.839115 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d45fd681-b647-4ffd-8064-0df25408474f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.178755 Sep 08 14:04:21.839472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 303/603] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:21 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:21.849417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6575978c-272b-40bd-84ab-e9cacf026ff4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:21.851261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6575978c-272b-40bd-84ab-e9cacf026ff4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:21.858116 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6575978c-272b-40bd-84ab-e9cacf026ff4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:21.858725 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6575978c-272b-40bd-84ab-e9cacf026ff4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:21.859203 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6575978c-272b-40bd-84ab-e9cacf026ff4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:21.859909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6575978c-272b-40bd-84ab-e9cacf026ff4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:21.860394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6575978c-272b-40bd-84ab-e9cacf026ff4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:21.860920 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6575978c-272b-40bd-84ab-e9cacf026ff4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:21.944442 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f23dafd6-d410-47b0-9be9-86e87123aa78 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:21.945499 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f23dafd6-d410-47b0-9be9-86e87123aa78 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:21.952404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f23dafd6-d410-47b0-9be9-86e87123aa78 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:21.953399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f23dafd6-d410-47b0-9be9-86e87123aa78 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:21.953860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f23dafd6-d410-47b0-9be9-86e87123aa78 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:21.954645 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f23dafd6-d410-47b0-9be9-86e87123aa78 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:21.955126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f23dafd6-d410-47b0-9be9-86e87123aa78 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:21.955554 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f23dafd6-d410-47b0-9be9-86e87123aa78 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:22.047673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-6575978c-272b-40bd-84ab-e9cacf026ff4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:22.058559 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6575978c-272b-40bd-84ab-e9cacf026ff4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1368 microversion: 2.1 time: 0.214863 Sep 08 14:04:22.059197 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 301/604] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:21 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:22.065134 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-89a70992-61bc-47d4-85df-cbbaefc413a6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:22.080721 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-89a70992-61bc-47d4-85df-cbbaefc413a6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:22.080721 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89a70992-61bc-47d4-85df-cbbaefc413a6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:22.080721 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89a70992-61bc-47d4-85df-cbbaefc413a6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:22.080721 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89a70992-61bc-47d4-85df-cbbaefc413a6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:22.081133 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89a70992-61bc-47d4-85df-cbbaefc413a6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:22.081133 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89a70992-61bc-47d4-85df-cbbaefc413a6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:22.081133 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-89a70992-61bc-47d4-85df-cbbaefc413a6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:22.081133 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:22.093365 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f23dafd6-d410-47b0-9be9-86e87123aa78 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:22.104833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f23dafd6-d410-47b0-9be9-86e87123aa78 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.164494 Sep 08 14:04:22.105528 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 304/605] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:21 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:22.221571 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-89a70992-61bc-47d4-85df-cbbaefc413a6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:22.235267 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-89a70992-61bc-47d4-85df-cbbaefc413a6 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1758 microversion: 2.1 time: 0.174680 Sep 08 14:04:22.236251 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 302/606] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:22 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:22.865736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:22.866341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:22.868252 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=4 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:22.873640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:22.874130 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:22.874564 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:22.875347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:22.875804 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:22.876228 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:23.083566 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d60048a0-ba2a-4c2e-af14-6ded2ac87a59 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:23.084897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d60048a0-ba2a-4c2e-af14-6ded2ac87a59 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:23.094120 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d60048a0-ba2a-4c2e-af14-6ded2ac87a59 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:23.095080 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d60048a0-ba2a-4c2e-af14-6ded2ac87a59 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:23.095511 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d60048a0-ba2a-4c2e-af14-6ded2ac87a59 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:23.096238 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d60048a0-ba2a-4c2e-af14-6ded2ac87a59 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:23.096681 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d60048a0-ba2a-4c2e-af14-6ded2ac87a59 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:23.097595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d60048a0-ba2a-4c2e-af14-6ded2ac87a59 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:23.280275 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:23.291155 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:23.293535 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:23.294745 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ac4701da-7193-4a20-83bb-a37b35a2bd2f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.433029 Sep 08 14:04:23.307186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 305/607] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:22 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:04:23.307186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f701b097-ff3e-470a-b70e-49532900384e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:23.307186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f701b097-ff3e-470a-b70e-49532900384e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:23.307570 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f701b097-ff3e-470a-b70e-49532900384e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:23.307900 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f701b097-ff3e-470a-b70e-49532900384e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:23.308333 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f701b097-ff3e-470a-b70e-49532900384e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:23.309039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f701b097-ff3e-470a-b70e-49532900384e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:23.309548 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f701b097-ff3e-470a-b70e-49532900384e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:23.310030 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f701b097-ff3e-470a-b70e-49532900384e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:23.478141 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f701b097-ff3e-470a-b70e-49532900384e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:23.500784 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f701b097-ff3e-470a-b70e-49532900384e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.203687 Sep 08 14:04:23.501682 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 306/608] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:23 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:23.511661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f7317a83-5bef-471c-8c5c-23030767465d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:23.512431 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f7317a83-5bef-471c-8c5c-23030767465d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:23.519563 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7317a83-5bef-471c-8c5c-23030767465d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:23.520056 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7317a83-5bef-471c-8c5c-23030767465d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:23.520491 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7317a83-5bef-471c-8c5c-23030767465d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:23.521532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7317a83-5bef-471c-8c5c-23030767465d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:23.521990 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7317a83-5bef-471c-8c5c-23030767465d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:23.523303 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f7317a83-5bef-471c-8c5c-23030767465d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:23.531461 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:23.566676 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d60048a0-ba2a-4c2e-af14-6ded2ac87a59 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:23.575850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d60048a0-ba2a-4c2e-af14-6ded2ac87a59 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1368 microversion: 2.1 time: 0.496975 Sep 08 14:04:23.576757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 303/609] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:23 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1368 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:23.703489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f7317a83-5bef-471c-8c5c-23030767465d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:23.712417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f7317a83-5bef-471c-8c5c-23030767465d tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1758 microversion: 2.1 time: 0.209372 Sep 08 14:04:23.712998 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 307/610] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:23 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1758 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:24.322249 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:24.322793 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:24.329915 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.330398 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.330826 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.331575 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.332026 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.332448 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.488938 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:24.496462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:24.497892 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:24.499083 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f866fb5b-e0e1-4cb3-b9a1-1797e2d2441a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1806 microversion: 2.20 time: 0.181051 Sep 08 14:04:24.500131 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 304/611] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:24 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:04:24.525731 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f2ed266c-2ace-4560-8dc2-30f0349f64ee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:24.526331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f2ed266c-2ace-4560-8dc2-30f0349f64ee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:24.532774 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2ed266c-2ace-4560-8dc2-30f0349f64ee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.533257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2ed266c-2ace-4560-8dc2-30f0349f64ee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.533684 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2ed266c-2ace-4560-8dc2-30f0349f64ee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.534365 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2ed266c-2ace-4560-8dc2-30f0349f64ee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.534808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2ed266c-2ace-4560-8dc2-30f0349f64ee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.535265 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f2ed266c-2ace-4560-8dc2-30f0349f64ee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.614074 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5fc49b20-d0f3-4192-ab2b-6b50ef9a2c42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:24.614726 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5fc49b20-d0f3-4192-ab2b-6b50ef9a2c42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:24.620959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fc49b20-d0f3-4192-ab2b-6b50ef9a2c42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.621451 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fc49b20-d0f3-4192-ab2b-6b50ef9a2c42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.621888 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fc49b20-d0f3-4192-ab2b-6b50ef9a2c42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.622607 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fc49b20-d0f3-4192-ab2b-6b50ef9a2c42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.623097 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fc49b20-d0f3-4192-ab2b-6b50ef9a2c42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.623522 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fc49b20-d0f3-4192-ab2b-6b50ef9a2c42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.696980 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f2ed266c-2ace-4560-8dc2-30f0349f64ee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:24.705638 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f2ed266c-2ace-4560-8dc2-30f0349f64ee tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.183872 Sep 08 14:04:24.706225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 308/612] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:24 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:24.738663 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c5077a4b-06ef-448b-bf3f-98f1e6955aba tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:24.739798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c5077a4b-06ef-448b-bf3f-98f1e6955aba tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:24.745591 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c5077a4b-06ef-448b-bf3f-98f1e6955aba tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.749443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c5077a4b-06ef-448b-bf3f-98f1e6955aba tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.749443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c5077a4b-06ef-448b-bf3f-98f1e6955aba tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.749443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c5077a4b-06ef-448b-bf3f-98f1e6955aba tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.749443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c5077a4b-06ef-448b-bf3f-98f1e6955aba tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.750556 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c5077a4b-06ef-448b-bf3f-98f1e6955aba tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.775660 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5fc49b20-d0f3-4192-ab2b-6b50ef9a2c42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:24.783935 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5fc49b20-d0f3-4192-ab2b-6b50ef9a2c42 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1368 microversion: 2.1 time: 0.173891 Sep 08 14:04:24.784940 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 305/613] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:24 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:24.925489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c5077a4b-06ef-448b-bf3f-98f1e6955aba tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:24.929857 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c5077a4b-06ef-448b-bf3f-98f1e6955aba tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1758 microversion: 2.1 time: 0.195524 Sep 08 14:04:24.930469 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 309/614] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:24 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1758 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:25.534057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:25.535353 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:25.543499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.544008 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.544485 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.545447 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.546354 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.546927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.712529 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:25.722292 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:25.723894 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:25.725084 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-50b0eaa0-604b-4a52-8579-22240911da95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1793 microversion: 2.20 time: 0.199130 Sep 08 14:04:25.725641 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 306/615] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:04:25 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1793 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:04:25.728260 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-aa120020-ebde-4992-86fc-599c5e24a131 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:25.729199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-aa120020-ebde-4992-86fc-599c5e24a131 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:25.735427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa120020-ebde-4992-86fc-599c5e24a131 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.735955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa120020-ebde-4992-86fc-599c5e24a131 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.736335 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa120020-ebde-4992-86fc-599c5e24a131 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.737024 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa120020-ebde-4992-86fc-599c5e24a131 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.737472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa120020-ebde-4992-86fc-599c5e24a131 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.737886 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aa120020-ebde-4992-86fc-599c5e24a131 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.808991 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b60b9b75-3968-47fb-a559-352863a9fbc0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:25.809608 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b60b9b75-3968-47fb-a559-352863a9fbc0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:25.817227 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b60b9b75-3968-47fb-a559-352863a9fbc0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.817731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b60b9b75-3968-47fb-a559-352863a9fbc0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.818165 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b60b9b75-3968-47fb-a559-352863a9fbc0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.818875 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b60b9b75-3968-47fb-a559-352863a9fbc0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.819521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b60b9b75-3968-47fb-a559-352863a9fbc0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.820143 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b60b9b75-3968-47fb-a559-352863a9fbc0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.902234 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-aa120020-ebde-4992-86fc-599c5e24a131 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:25.919832 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-aa120020-ebde-4992-86fc-599c5e24a131 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.193985 Sep 08 14:04:25.920973 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 310/616] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:25 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:25.960286 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:25.962046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d10eeed0-8ff0-441c-b743-b650f64bc263 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:25.962665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d10eeed0-8ff0-441c-b743-b650f64bc263 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:25.969384 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d10eeed0-8ff0-441c-b743-b650f64bc263 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.970075 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d10eeed0-8ff0-441c-b743-b650f64bc263 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.970722 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d10eeed0-8ff0-441c-b743-b650f64bc263 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.971563 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d10eeed0-8ff0-441c-b743-b650f64bc263 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.972023 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d10eeed0-8ff0-441c-b743-b650f64bc263 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.972448 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d10eeed0-8ff0-441c-b743-b650f64bc263 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.998988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b60b9b75-3968-47fb-a559-352863a9fbc0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:26.010856 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b60b9b75-3968-47fb-a559-352863a9fbc0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1368 microversion: 2.1 time: 0.205792 Sep 08 14:04:26.011491 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 307/617] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:25 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:26.137345 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d10eeed0-8ff0-441c-b743-b650f64bc263 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:26.146112 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d10eeed0-8ff0-441c-b743-b650f64bc263 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1761 microversion: 2.1 time: 0.188952 Sep 08 14:04:26.146703 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 311/618] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:25 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1761 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:26.944706 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-98b0a6f3-3100-4922-b84a-3d1516b976b5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:26.945315 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-98b0a6f3-3100-4922-b84a-3d1516b976b5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:26.947555 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=8 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:26.952821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98b0a6f3-3100-4922-b84a-3d1516b976b5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:26.953304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98b0a6f3-3100-4922-b84a-3d1516b976b5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:26.953738 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98b0a6f3-3100-4922-b84a-3d1516b976b5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:26.954483 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98b0a6f3-3100-4922-b84a-3d1516b976b5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:26.954981 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98b0a6f3-3100-4922-b84a-3d1516b976b5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:26.955405 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98b0a6f3-3100-4922-b84a-3d1516b976b5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:27.034170 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b407f953-de6c-424b-b1a5-69c72260baa1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:27.034816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b407f953-de6c-424b-b1a5-69c72260baa1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:27.041766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b407f953-de6c-424b-b1a5-69c72260baa1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:27.042253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b407f953-de6c-424b-b1a5-69c72260baa1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:27.042697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b407f953-de6c-424b-b1a5-69c72260baa1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:27.043427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b407f953-de6c-424b-b1a5-69c72260baa1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:27.043878 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b407f953-de6c-424b-b1a5-69c72260baa1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:27.044301 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b407f953-de6c-424b-b1a5-69c72260baa1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:27.090804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-98b0a6f3-3100-4922-b84a-3d1516b976b5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:27.100236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-98b0a6f3-3100-4922-b84a-3d1516b976b5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.159356 Sep 08 14:04:27.100828 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 308/619] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:26 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:27.185333 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b407f953-de6c-424b-b1a5-69c72260baa1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:27.194195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b407f953-de6c-424b-b1a5-69c72260baa1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1368 microversion: 2.1 time: 0.164322 Sep 08 14:04:27.194705 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 312/620] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:27 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:28.123874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-46fb9f73-f34d-446c-84a8-ab0f15dc13cb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:28.125086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-46fb9f73-f34d-446c-84a8-ab0f15dc13cb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:28.132938 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46fb9f73-f34d-446c-84a8-ab0f15dc13cb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:28.133428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46fb9f73-f34d-446c-84a8-ab0f15dc13cb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:28.133877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46fb9f73-f34d-446c-84a8-ab0f15dc13cb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:28.134605 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46fb9f73-f34d-446c-84a8-ab0f15dc13cb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:28.135088 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46fb9f73-f34d-446c-84a8-ab0f15dc13cb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:28.135563 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-46fb9f73-f34d-446c-84a8-ab0f15dc13cb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:28.197840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-84d80a16-9d04-4df0-b656-19e94237303b req-b2c2e2fb-373e-46fd-b9c6-440b0e8d13b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789dd836-53d0-47a2-99a0-543e2997ad11", "name": "network-vif-plugged", "status": "completed", "tag": "bd2176c3-7d91-4643-8017-87305f438b36"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:28.209005 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-84d80a16-9d04-4df0-b656-19e94237303b req-b2c2e2fb-373e-46fd-b9c6-440b0e8d13b3 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:28.209489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-84d80a16-9d04-4df0-b656-19e94237303b req-b2c2e2fb-373e-46fd-b9c6-440b0e8d13b3 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:28.209918 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-84d80a16-9d04-4df0-b656-19e94237303b req-b2c2e2fb-373e-46fd-b9c6-440b0e8d13b3 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:28.221715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-84d80a16-9d04-4df0-b656-19e94237303b req-b2c2e2fb-373e-46fd-b9c6-440b0e8d13b3 service nova] Creating event network-vif-plugged:bd2176c3-7d91-4643-8017-87305f438b36 for instance 789dd836-53d0-47a2-99a0-543e2997ad11 on hv-cinder-84773 Sep 08 14:04:28.227702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-84d80a16-9d04-4df0-b656-19e94237303b req-b2c2e2fb-373e-46fd-b9c6-440b0e8d13b3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033231 Sep 08 14:04:28.228453 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 313/621] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:04:28.236785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c84ea8c2-9b37-4456-b00b-c6ae94e79831 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:28.237489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c84ea8c2-9b37-4456-b00b-c6ae94e79831 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:28.244173 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c84ea8c2-9b37-4456-b00b-c6ae94e79831 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:28.244665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c84ea8c2-9b37-4456-b00b-c6ae94e79831 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:28.245269 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c84ea8c2-9b37-4456-b00b-c6ae94e79831 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:28.245964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c84ea8c2-9b37-4456-b00b-c6ae94e79831 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:28.246418 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c84ea8c2-9b37-4456-b00b-c6ae94e79831 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:28.246846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c84ea8c2-9b37-4456-b00b-c6ae94e79831 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:28.278572 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-46fb9f73-f34d-446c-84a8-ab0f15dc13cb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:28.291782 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-46fb9f73-f34d-446c-84a8-ab0f15dc13cb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.171835 Sep 08 14:04:28.292849 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 309/622] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:28 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:28.387819 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c84ea8c2-9b37-4456-b00b-c6ae94e79831 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:28.396167 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c84ea8c2-9b37-4456-b00b-c6ae94e79831 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1368 microversion: 2.1 time: 0.163670 Sep 08 14:04:28.396725 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 314/623] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:28 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:29.316240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-eb361a93-6873-46ab-9610-f2aa2ad0a1ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:29.316847 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-eb361a93-6873-46ab-9610-f2aa2ad0a1ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:29.322972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eb361a93-6873-46ab-9610-f2aa2ad0a1ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:29.323457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eb361a93-6873-46ab-9610-f2aa2ad0a1ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:29.323888 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eb361a93-6873-46ab-9610-f2aa2ad0a1ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:29.324580 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eb361a93-6873-46ab-9610-f2aa2ad0a1ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:29.325030 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eb361a93-6873-46ab-9610-f2aa2ad0a1ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:29.325456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eb361a93-6873-46ab-9610-f2aa2ad0a1ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:29.418754 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4760ad4b-94f3-4f0a-977f-c3fd3690766e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:29.419499 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4760ad4b-94f3-4f0a-977f-c3fd3690766e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:29.426692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4760ad4b-94f3-4f0a-977f-c3fd3690766e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:29.427223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4760ad4b-94f3-4f0a-977f-c3fd3690766e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:29.427655 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4760ad4b-94f3-4f0a-977f-c3fd3690766e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:29.428352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4760ad4b-94f3-4f0a-977f-c3fd3690766e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:29.428962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4760ad4b-94f3-4f0a-977f-c3fd3690766e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:29.429295 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4760ad4b-94f3-4f0a-977f-c3fd3690766e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:29.468363 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-eb361a93-6873-46ab-9610-f2aa2ad0a1ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:29.478061 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-eb361a93-6873-46ab-9610-f2aa2ad0a1ce tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.166318 Sep 08 14:04:29.478644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 310/624] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:29 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:29.568552 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4760ad4b-94f3-4f0a-977f-c3fd3690766e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:29.576374 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4760ad4b-94f3-4f0a-977f-c3fd3690766e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1368 microversion: 2.1 time: 0.161397 Sep 08 14:04:29.576984 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 315/625] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:29 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:30.502000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c76d90ef-17a6-4aa4-aaf5-2c2286f58e62 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:30.502599 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c76d90ef-17a6-4aa4-aaf5-2c2286f58e62 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:30.509202 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c76d90ef-17a6-4aa4-aaf5-2c2286f58e62 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:30.509683 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c76d90ef-17a6-4aa4-aaf5-2c2286f58e62 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:30.510117 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c76d90ef-17a6-4aa4-aaf5-2c2286f58e62 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:30.510815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c76d90ef-17a6-4aa4-aaf5-2c2286f58e62 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:30.511296 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c76d90ef-17a6-4aa4-aaf5-2c2286f58e62 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:30.511715 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c76d90ef-17a6-4aa4-aaf5-2c2286f58e62 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:30.600247 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-174d5f58-792a-4e7c-877a-edc9e7606c91 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:30.601506 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-174d5f58-792a-4e7c-877a-edc9e7606c91 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:30.609300 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-174d5f58-792a-4e7c-877a-edc9e7606c91 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:30.609788 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-174d5f58-792a-4e7c-877a-edc9e7606c91 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:30.610216 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-174d5f58-792a-4e7c-877a-edc9e7606c91 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:30.610938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-174d5f58-792a-4e7c-877a-edc9e7606c91 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:30.611414 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-174d5f58-792a-4e7c-877a-edc9e7606c91 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:30.611905 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-174d5f58-792a-4e7c-877a-edc9e7606c91 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:30.660594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c76d90ef-17a6-4aa4-aaf5-2c2286f58e62 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:30.679176 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c76d90ef-17a6-4aa4-aaf5-2c2286f58e62 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.181389 Sep 08 14:04:30.680091 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 311/626] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:30 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:30.748584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-174d5f58-792a-4e7c-877a-edc9e7606c91 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:30.758545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-174d5f58-792a-4e7c-877a-edc9e7606c91 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1368 microversion: 2.1 time: 0.162031 Sep 08 14:04:30.759463 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 316/627] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:30 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:31.704062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a1757300-7c79-4c39-9d70-4a52847f3a48 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:31.704661 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a1757300-7c79-4c39-9d70-4a52847f3a48 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:31.711039 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1757300-7c79-4c39-9d70-4a52847f3a48 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:31.711523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1757300-7c79-4c39-9d70-4a52847f3a48 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:31.711952 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1757300-7c79-4c39-9d70-4a52847f3a48 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:31.712630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1757300-7c79-4c39-9d70-4a52847f3a48 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:31.713073 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1757300-7c79-4c39-9d70-4a52847f3a48 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:31.713484 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a1757300-7c79-4c39-9d70-4a52847f3a48 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:31.783319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a22194c1-d92e-4d58-af49-da6f639aff02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:31.784511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a22194c1-d92e-4d58-af49-da6f639aff02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:31.792301 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a22194c1-d92e-4d58-af49-da6f639aff02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:31.793223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a22194c1-d92e-4d58-af49-da6f639aff02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:31.793929 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a22194c1-d92e-4d58-af49-da6f639aff02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:31.795242 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a22194c1-d92e-4d58-af49-da6f639aff02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:31.795973 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a22194c1-d92e-4d58-af49-da6f639aff02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:31.796712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a22194c1-d92e-4d58-af49-da6f639aff02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:31.859740 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-a1757300-7c79-4c39-9d70-4a52847f3a48 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:31.867961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a1757300-7c79-4c39-9d70-4a52847f3a48 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.168434 Sep 08 14:04:31.868540 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 312/628] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:31 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:31.947034 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a22194c1-d92e-4d58-af49-da6f639aff02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:31.955494 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a22194c1-d92e-4d58-af49-da6f639aff02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1557 microversion: 2.1 time: 0.177258 Sep 08 14:04:31.956059 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 317/629] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:31 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:31.978043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-02cbd52a-82b2-484a-aea8-9fb2bb9438ab tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:31.978535 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-02cbd52a-82b2-484a-aea8-9fb2bb9438ab tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:31.984711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02cbd52a-82b2-484a-aea8-9fb2bb9438ab tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:31.985195 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02cbd52a-82b2-484a-aea8-9fb2bb9438ab tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:31.985639 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02cbd52a-82b2-484a-aea8-9fb2bb9438ab tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:31.986324 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02cbd52a-82b2-484a-aea8-9fb2bb9438ab tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:31.986777 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02cbd52a-82b2-484a-aea8-9fb2bb9438ab tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:31.987347 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02cbd52a-82b2-484a-aea8-9fb2bb9438ab tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:32.067214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-02cbd52a-82b2-484a-aea8-9fb2bb9438ab tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093005 Sep 08 14:04:32.067817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 313/630] 10.222.0.91 () {58 vars in 1275 bytes} [Thu Sep 8 14:04:31 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:04:32.893748 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d5a5362c-61f2-4ba0-8678-65fa0977eb42 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:32.894474 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d5a5362c-61f2-4ba0-8678-65fa0977eb42 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:32.901087 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5a5362c-61f2-4ba0-8678-65fa0977eb42 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:32.901561 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5a5362c-61f2-4ba0-8678-65fa0977eb42 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:32.901990 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5a5362c-61f2-4ba0-8678-65fa0977eb42 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:32.902672 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5a5362c-61f2-4ba0-8678-65fa0977eb42 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:32.903140 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5a5362c-61f2-4ba0-8678-65fa0977eb42 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:32.903565 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5a5362c-61f2-4ba0-8678-65fa0977eb42 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:33.035915 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d5a5362c-61f2-4ba0-8678-65fa0977eb42 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:33.044204 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d5a5362c-61f2-4ba0-8678-65fa0977eb42 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.155012 Sep 08 14:04:33.044788 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 318/631] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:32 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:33.092393 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-22f3c1ac-8217-4457-9229-12098d6db32b req-3f147b26-7bf7-4436-94ae-372b91db9e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "789dd836-53d0-47a2-99a0-543e2997ad11", "tag": "bd2176c3-7d91-4643-8017-87305f438b36"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:33.102167 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-22f3c1ac-8217-4457-9229-12098d6db32b req-3f147b26-7bf7-4436-94ae-372b91db9e28 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:33.102729 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-22f3c1ac-8217-4457-9229-12098d6db32b req-3f147b26-7bf7-4436-94ae-372b91db9e28 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:33.103262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-22f3c1ac-8217-4457-9229-12098d6db32b req-3f147b26-7bf7-4436-94ae-372b91db9e28 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:33.115329 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-22f3c1ac-8217-4457-9229-12098d6db32b req-3f147b26-7bf7-4436-94ae-372b91db9e28 service nova] Creating event network-changed:bd2176c3-7d91-4643-8017-87305f438b36 for instance 789dd836-53d0-47a2-99a0-543e2997ad11 on hv-cinder-84773 Sep 08 14:04:33.120640 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-22f3c1ac-8217-4457-9229-12098d6db32b req-3f147b26-7bf7-4436-94ae-372b91db9e28 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032331 Sep 08 14:04:33.121272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 314/632] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:04:34.068572 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-138a4e81-ef10-4cbc-a4c6-b1a7801ecf96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:34.069395 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-138a4e81-ef10-4cbc-a4c6-b1a7801ecf96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:34.076005 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-138a4e81-ef10-4cbc-a4c6-b1a7801ecf96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.076493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-138a4e81-ef10-4cbc-a4c6-b1a7801ecf96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.076938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-138a4e81-ef10-4cbc-a4c6-b1a7801ecf96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.078198 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-138a4e81-ef10-4cbc-a4c6-b1a7801ecf96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.078665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-138a4e81-ef10-4cbc-a4c6-b1a7801ecf96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.079139 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-138a4e81-ef10-4cbc-a4c6-b1a7801ecf96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.211697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-138a4e81-ef10-4cbc-a4c6-b1a7801ecf96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:34.219451 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-138a4e81-ef10-4cbc-a4c6-b1a7801ecf96 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.154721 Sep 08 14:04:34.220169 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 319/633] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:34 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:35.244361 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4a3fbc06-ad69-4356-9a09-760a359cc965 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:35.245225 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4a3fbc06-ad69-4356-9a09-760a359cc965 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:35.251782 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4a3fbc06-ad69-4356-9a09-760a359cc965 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:35.252262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4a3fbc06-ad69-4356-9a09-760a359cc965 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:35.252697 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4a3fbc06-ad69-4356-9a09-760a359cc965 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:35.253396 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4a3fbc06-ad69-4356-9a09-760a359cc965 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:35.253849 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4a3fbc06-ad69-4356-9a09-760a359cc965 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:35.254302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4a3fbc06-ad69-4356-9a09-760a359cc965 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:35.403411 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4a3fbc06-ad69-4356-9a09-760a359cc965 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:35.412046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4a3fbc06-ad69-4356-9a09-760a359cc965 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.172412 Sep 08 14:04:35.412606 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 315/634] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:35 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:36.436300 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f460089f-12e1-4aa2-a0f5-9e57a7918ef5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:36.436811 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f460089f-12e1-4aa2-a0f5-9e57a7918ef5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:36.443984 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f460089f-12e1-4aa2-a0f5-9e57a7918ef5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:36.444471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f460089f-12e1-4aa2-a0f5-9e57a7918ef5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:36.444910 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f460089f-12e1-4aa2-a0f5-9e57a7918ef5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:36.445598 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f460089f-12e1-4aa2-a0f5-9e57a7918ef5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:36.446056 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f460089f-12e1-4aa2-a0f5-9e57a7918ef5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:36.446478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f460089f-12e1-4aa2-a0f5-9e57a7918ef5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:36.594994 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f460089f-12e1-4aa2-a0f5-9e57a7918ef5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:36.604551 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f460089f-12e1-4aa2-a0f5-9e57a7918ef5 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.172226 Sep 08 14:04:36.605126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 320/635] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:36 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:37.628096 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5e181249-097b-4ce5-b16d-efa1e0c71dd1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:37.628919 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5e181249-097b-4ce5-b16d-efa1e0c71dd1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:37.635861 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e181249-097b-4ce5-b16d-efa1e0c71dd1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:37.636344 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e181249-097b-4ce5-b16d-efa1e0c71dd1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:37.636768 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e181249-097b-4ce5-b16d-efa1e0c71dd1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:37.637456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e181249-097b-4ce5-b16d-efa1e0c71dd1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:37.637897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e181249-097b-4ce5-b16d-efa1e0c71dd1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:37.638338 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e181249-097b-4ce5-b16d-efa1e0c71dd1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:37.776238 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5e181249-097b-4ce5-b16d-efa1e0c71dd1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:37.785626 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5e181249-097b-4ce5-b16d-efa1e0c71dd1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.161538 Sep 08 14:04:37.786211 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 316/636] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:37 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:38.810666 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3d4bc3b0-dc51-44ee-adaf-3a119d10613b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:38.811330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3d4bc3b0-dc51-44ee-adaf-3a119d10613b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:38.818293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3d4bc3b0-dc51-44ee-adaf-3a119d10613b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:38.818789 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3d4bc3b0-dc51-44ee-adaf-3a119d10613b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:38.819258 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3d4bc3b0-dc51-44ee-adaf-3a119d10613b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:38.819989 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3d4bc3b0-dc51-44ee-adaf-3a119d10613b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:38.820447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3d4bc3b0-dc51-44ee-adaf-3a119d10613b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:38.820880 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3d4bc3b0-dc51-44ee-adaf-3a119d10613b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:38.967799 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3d4bc3b0-dc51-44ee-adaf-3a119d10613b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:38.977382 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3d4bc3b0-dc51-44ee-adaf-3a119d10613b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.171380 Sep 08 14:04:38.977960 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 321/637] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:38 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:40.001262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f7822c11-3826-4ade-a2f8-9aaf56901664 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:40.002244 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f7822c11-3826-4ade-a2f8-9aaf56901664 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:40.012425 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7822c11-3826-4ade-a2f8-9aaf56901664 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:40.013205 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7822c11-3826-4ade-a2f8-9aaf56901664 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:40.013739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7822c11-3826-4ade-a2f8-9aaf56901664 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:40.015442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7822c11-3826-4ade-a2f8-9aaf56901664 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:40.016415 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7822c11-3826-4ade-a2f8-9aaf56901664 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:40.017163 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f7822c11-3826-4ade-a2f8-9aaf56901664 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:40.214387 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f7822c11-3826-4ade-a2f8-9aaf56901664 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:40.222887 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f7822c11-3826-4ade-a2f8-9aaf56901664 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.225963 Sep 08 14:04:40.223493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 317/638] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:39 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:41.247202 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5e32b14f-bea0-4ee5-9866-779632101329 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:41.247909 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5e32b14f-bea0-4ee5-9866-779632101329 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:41.254406 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e32b14f-bea0-4ee5-9866-779632101329 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:41.254916 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e32b14f-bea0-4ee5-9866-779632101329 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:41.255359 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e32b14f-bea0-4ee5-9866-779632101329 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:41.256049 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e32b14f-bea0-4ee5-9866-779632101329 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:41.256502 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e32b14f-bea0-4ee5-9866-779632101329 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:41.256923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e32b14f-bea0-4ee5-9866-779632101329 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:41.448644 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5e32b14f-bea0-4ee5-9866-779632101329 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:41.457600 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5e32b14f-bea0-4ee5-9866-779632101329 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.214682 Sep 08 14:04:41.458170 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 322/639] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:41 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:42.484869 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-168b8fb6-c505-4aa7-9135-fd5dbb4b8d9e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:42.486751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-168b8fb6-c505-4aa7-9135-fd5dbb4b8d9e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:42.495995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-168b8fb6-c505-4aa7-9135-fd5dbb4b8d9e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:42.496489 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-168b8fb6-c505-4aa7-9135-fd5dbb4b8d9e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:42.496928 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-168b8fb6-c505-4aa7-9135-fd5dbb4b8d9e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:42.497634 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-168b8fb6-c505-4aa7-9135-fd5dbb4b8d9e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:42.498091 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-168b8fb6-c505-4aa7-9135-fd5dbb4b8d9e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:42.498512 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-168b8fb6-c505-4aa7-9135-fd5dbb4b8d9e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:42.638019 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-168b8fb6-c505-4aa7-9135-fd5dbb4b8d9e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:42.647755 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-168b8fb6-c505-4aa7-9135-fd5dbb4b8d9e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.169997 Sep 08 14:04:42.648290 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 318/640] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:42 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:43.671910 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ade22c56-f7c3-4f1c-98f0-8350b6d77a60 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:43.672637 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ade22c56-f7c3-4f1c-98f0-8350b6d77a60 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:43.679467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ade22c56-f7c3-4f1c-98f0-8350b6d77a60 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:43.679948 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ade22c56-f7c3-4f1c-98f0-8350b6d77a60 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:43.680380 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ade22c56-f7c3-4f1c-98f0-8350b6d77a60 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:43.681212 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ade22c56-f7c3-4f1c-98f0-8350b6d77a60 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:43.681665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ade22c56-f7c3-4f1c-98f0-8350b6d77a60 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:43.682088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ade22c56-f7c3-4f1c-98f0-8350b6d77a60 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:43.818209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ade22c56-f7c3-4f1c-98f0-8350b6d77a60 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:43.826450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ade22c56-f7c3-4f1c-98f0-8350b6d77a60 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.158944 Sep 08 14:04:43.827128 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 323/641] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:43 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:44.851201 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4aea7349-7d15-4fba-b71f-789a505279a7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:44.851868 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4aea7349-7d15-4fba-b71f-789a505279a7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:44.858433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aea7349-7d15-4fba-b71f-789a505279a7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:44.858966 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aea7349-7d15-4fba-b71f-789a505279a7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:44.859424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aea7349-7d15-4fba-b71f-789a505279a7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:44.860139 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aea7349-7d15-4fba-b71f-789a505279a7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:44.860583 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aea7349-7d15-4fba-b71f-789a505279a7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:44.861006 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aea7349-7d15-4fba-b71f-789a505279a7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:45.063395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4aea7349-7d15-4fba-b71f-789a505279a7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:45.067047 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=100 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:45.072221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4aea7349-7d15-4fba-b71f-789a505279a7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.225031 Sep 08 14:04:45.072798 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 319/642] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:44 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:46.096085 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-215e733f-9898-4c7d-945a-69c80649f632 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:46.097086 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-215e733f-9898-4c7d-945a-69c80649f632 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:46.103470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-215e733f-9898-4c7d-945a-69c80649f632 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:46.103944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-215e733f-9898-4c7d-945a-69c80649f632 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:46.104369 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-215e733f-9898-4c7d-945a-69c80649f632 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:46.105049 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-215e733f-9898-4c7d-945a-69c80649f632 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:46.105497 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-215e733f-9898-4c7d-945a-69c80649f632 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:46.105908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-215e733f-9898-4c7d-945a-69c80649f632 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:46.124634 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:46.243645 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-215e733f-9898-4c7d-945a-69c80649f632 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:46.252294 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-215e733f-9898-4c7d-945a-69c80649f632 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1735 microversion: 2.1 time: 0.160722 Sep 08 14:04:46.252861 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 324/643] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:46 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:47.279710 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-80c6e656-c1d8-401b-9962-881bf1813b24 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:47.281275 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-80c6e656-c1d8-401b-9962-881bf1813b24 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:47.287274 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80c6e656-c1d8-401b-9962-881bf1813b24 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.287762 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80c6e656-c1d8-401b-9962-881bf1813b24 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.288198 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80c6e656-c1d8-401b-9962-881bf1813b24 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.288900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80c6e656-c1d8-401b-9962-881bf1813b24 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.289352 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80c6e656-c1d8-401b-9962-881bf1813b24 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.289778 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80c6e656-c1d8-401b-9962-881bf1813b24 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.424600 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-80c6e656-c1d8-401b-9962-881bf1813b24 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:47.433018 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-80c6e656-c1d8-401b-9962-881bf1813b24 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1715 microversion: 2.1 time: 0.157549 Sep 08 14:04:47.433631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 320/644] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:47 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:47.551240 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:47.551993 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:47.554357 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=66 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:47.559420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.589895 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.589895 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.589895 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.589895 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.590346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.647610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] HTTP exception thrown: Cannot 'detach_volume' instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 while it is in vm_state rescued Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Request method failure captured: Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: DELETE /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments/37b93427-dda3-4721-aee6-72d8c2e29925 HTTP/1.1 Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVgsfQZT4q-AwtAeupucKbXfT6LGhmAzk0Dk9cZxUYc9pYOGHXV1Q14F05ICSXDdtU9v7LTi5J7ETbJGcmHJfaoROm1DUxoD2jYhOI4CMw5zblbDb9kPtA9N8mZ9DNzz-JlYodYsTwDVzUjTQ2Ub9wQwAnZ04e_ENmxl0_puCWPkQE Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 2078beb45799497ea367c552b6d8bcf9 Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:04:47.649633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_2078beb45799497ea367c552b6d8bcf9", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 2078beb45799497ea367c552b6d8bcf9 Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-ServerRescueNegativeTestJSON-993995764-project Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: e4916206c2ff42669276e0a93d6483ab Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-ServerRescueNegativeTestJSON-993995764-project Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:04:47.652675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Cannot 'detach_volume' instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 while it is in vm_state rescued Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'server_id': '4a905c87-01a3-4760-8c5c-7df6b9b7b190', 'id': '37b93427-dda3-4721-aee6-72d8c2e29925'} Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:04:47.654244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 while it is in vm_state rescued Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 while it is in vm_state rescued Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:04:47.657486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Returning 409 to user: Cannot 'detach_volume' instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 while it is in vm_state rescued {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:04:47.659315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e6e9bf3d-1e09-44ab-8c74-c21bbf5d074e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "DELETE /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments/37b93427-dda3-4721-aee6-72d8c2e29925" status: 409 len: 152 microversion: 2.1 time: 0.104093 Sep 08 14:04:47.659315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 325/645] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:04:47 2022] DELETE /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments/37b93427-dda3-4721-aee6-72d8c2e29925 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 14:04:47.660989 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-23db63d8-3ea4-45db-923c-e73eeffb5d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:47.661523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-23db63d8-3ea4-45db-923c-e73eeffb5d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:47.667514 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23db63d8-3ea4-45db-923c-e73eeffb5d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.667999 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23db63d8-3ea4-45db-923c-e73eeffb5d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.668431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23db63d8-3ea4-45db-923c-e73eeffb5d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.669126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23db63d8-3ea4-45db-923c-e73eeffb5d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.669580 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23db63d8-3ea4-45db-923c-e73eeffb5d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.670008 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-23db63d8-3ea4-45db-923c-e73eeffb5d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.945164 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-23db63d8-3ea4-45db-923c-e73eeffb5d7f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "POST /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/action" status: 202 len: 0 microversion: 2.1 time: 0.287837 Sep 08 14:04:47.945800 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 321/646] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:04:47 2022] POST /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:04:47.954692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7ba79731-6ef3-4b59-a0d1-66f4218ac808 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:47.960145 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7ba79731-6ef3-4b59-a0d1-66f4218ac808 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:47.963496 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ba79731-6ef3-4b59-a0d1-66f4218ac808 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.963980 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ba79731-6ef3-4b59-a0d1-66f4218ac808 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.964405 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ba79731-6ef3-4b59-a0d1-66f4218ac808 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.965126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ba79731-6ef3-4b59-a0d1-66f4218ac808 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.965609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ba79731-6ef3-4b59-a0d1-66f4218ac808 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.966030 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ba79731-6ef3-4b59-a0d1-66f4218ac808 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:48.103893 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7ba79731-6ef3-4b59-a0d1-66f4218ac808 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:48.112747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7ba79731-6ef3-4b59-a0d1-66f4218ac808 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1723 microversion: 2.1 time: 0.162273 Sep 08 14:04:48.113333 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 326/647] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:47 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:49.137293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7101b094-2f83-4b5d-a28d-bf14a9be836c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:49.137973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7101b094-2f83-4b5d-a28d-bf14a9be836c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:49.144417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7101b094-2f83-4b5d-a28d-bf14a9be836c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:49.145925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7101b094-2f83-4b5d-a28d-bf14a9be836c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:49.145925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7101b094-2f83-4b5d-a28d-bf14a9be836c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:49.147276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7101b094-2f83-4b5d-a28d-bf14a9be836c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:49.147276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7101b094-2f83-4b5d-a28d-bf14a9be836c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:49.147276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7101b094-2f83-4b5d-a28d-bf14a9be836c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:49.288986 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7101b094-2f83-4b5d-a28d-bf14a9be836c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:49.298045 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7101b094-2f83-4b5d-a28d-bf14a9be836c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1723 microversion: 2.1 time: 0.165458 Sep 08 14:04:49.298611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 322/648] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:49 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:50.321649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-024e9113-d48a-4ec5-8b6f-525cb1f618eb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:50.322250 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-024e9113-d48a-4ec5-8b6f-525cb1f618eb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:50.328744 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-024e9113-d48a-4ec5-8b6f-525cb1f618eb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:50.329223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-024e9113-d48a-4ec5-8b6f-525cb1f618eb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:50.329656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-024e9113-d48a-4ec5-8b6f-525cb1f618eb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:50.330332 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-024e9113-d48a-4ec5-8b6f-525cb1f618eb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:50.330778 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-024e9113-d48a-4ec5-8b6f-525cb1f618eb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:50.331223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-024e9113-d48a-4ec5-8b6f-525cb1f618eb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:50.462114 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-024e9113-d48a-4ec5-8b6f-525cb1f618eb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:50.470546 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-024e9113-d48a-4ec5-8b6f-525cb1f618eb tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1723 microversion: 2.1 time: 0.152770 Sep 08 14:04:50.471148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 327/649] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:50 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:51.495637 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-64eb6f9b-5fb2-40c3-a944-10bdf0f7e1b1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:51.496302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-64eb6f9b-5fb2-40c3-a944-10bdf0f7e1b1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:51.503886 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64eb6f9b-5fb2-40c3-a944-10bdf0f7e1b1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:51.504546 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64eb6f9b-5fb2-40c3-a944-10bdf0f7e1b1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:51.505010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64eb6f9b-5fb2-40c3-a944-10bdf0f7e1b1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.505717 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64eb6f9b-5fb2-40c3-a944-10bdf0f7e1b1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:51.506173 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64eb6f9b-5fb2-40c3-a944-10bdf0f7e1b1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:51.506600 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-64eb6f9b-5fb2-40c3-a944-10bdf0f7e1b1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.646412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-64eb6f9b-5fb2-40c3-a944-10bdf0f7e1b1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:51.658461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-64eb6f9b-5fb2-40c3-a944-10bdf0f7e1b1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1729 microversion: 2.1 time: 0.167526 Sep 08 14:04:51.659060 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 323/650] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:51 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:51.681924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0b99ae87-4e98-4020-81b1-0b8fef37cb82 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:51.682704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0b99ae87-4e98-4020-81b1-0b8fef37cb82 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:51.689295 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b99ae87-4e98-4020-81b1-0b8fef37cb82 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:51.692916 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b99ae87-4e98-4020-81b1-0b8fef37cb82 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:51.692916 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b99ae87-4e98-4020-81b1-0b8fef37cb82 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.692916 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b99ae87-4e98-4020-81b1-0b8fef37cb82 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:51.692916 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b99ae87-4e98-4020-81b1-0b8fef37cb82 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:51.693309 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b99ae87-4e98-4020-81b1-0b8fef37cb82 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.783849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0b99ae87-4e98-4020-81b1-0b8fef37cb82 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105870 Sep 08 14:04:51.784477 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 328/651] 10.222.0.91 () {58 vars in 1275 bytes} [Thu Sep 8 14:04:51 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:52.847224 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-57969c84-5fb5-47c1-b1a5-864e9026d0b6 req-c67424fd-d23b-4164-865c-bde2ff3e23e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a905c87-01a3-4760-8c5c-7df6b9b7b190", "tag": "98ad18af-5b71-4073-a0f8-4fcd2a13191f"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:52.855667 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=48 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:52.861108 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-57969c84-5fb5-47c1-b1a5-864e9026d0b6 req-c67424fd-d23b-4164-865c-bde2ff3e23e8 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.861746 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-57969c84-5fb5-47c1-b1a5-864e9026d0b6 req-c67424fd-d23b-4164-865c-bde2ff3e23e8 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.862177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-57969c84-5fb5-47c1-b1a5-864e9026d0b6 req-c67424fd-d23b-4164-865c-bde2ff3e23e8 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.873877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-57969c84-5fb5-47c1-b1a5-864e9026d0b6 req-c67424fd-d23b-4164-865c-bde2ff3e23e8 service nova] Creating event network-changed:98ad18af-5b71-4073-a0f8-4fcd2a13191f for instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 on hv-cinder-84773 Sep 08 14:04:52.879473 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-57969c84-5fb5-47c1-b1a5-864e9026d0b6 req-c67424fd-d23b-4164-865c-bde2ff3e23e8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038132 Sep 08 14:04:52.880079 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 324/652] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:53.248926 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-212f8764-f091-486d-82a9-ddf378a8742c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:53.252373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-212f8764-f091-486d-82a9-ddf378a8742c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:53.260496 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-212f8764-f091-486d-82a9-ddf378a8742c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.261141 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-212f8764-f091-486d-82a9-ddf378a8742c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.261684 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-212f8764-f091-486d-82a9-ddf378a8742c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.262589 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-212f8764-f091-486d-82a9-ddf378a8742c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.263175 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-212f8764-f091-486d-82a9-ddf378a8742c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.263898 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-212f8764-f091-486d-82a9-ddf378a8742c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.298754 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-212f8764-f091-486d-82a9-ddf378a8742c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054527 Sep 08 14:04:53.299924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 329/653] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:04:53 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:04:53.370140 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-edc29a9e-5164-46a1-8265-72b070484321 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:53.371185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-edc29a9e-5164-46a1-8265-72b070484321 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:53.381734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-edc29a9e-5164-46a1-8265-72b070484321 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.381734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-edc29a9e-5164-46a1-8265-72b070484321 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.381734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-edc29a9e-5164-46a1-8265-72b070484321 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.381734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-edc29a9e-5164-46a1-8265-72b070484321 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.382161 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-edc29a9e-5164-46a1-8265-72b070484321 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.382161 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-edc29a9e-5164-46a1-8265-72b070484321 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.410032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-edc29a9e-5164-46a1-8265-72b070484321 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Going to try to terminate instance {{(pid=133059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:04:53.774238 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-edc29a9e-5164-46a1-8265-72b070484321 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 204 len: 0 microversion: 2.1 time: 0.408120 Sep 08 14:04:53.778711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 325/654] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:04:53 2022] DELETE /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:04:53.784679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-23954eb4-4a85-4139-bc61-0f019a96ee9a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:53.785286 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-23954eb4-4a85-4139-bc61-0f019a96ee9a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:53.791679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23954eb4-4a85-4139-bc61-0f019a96ee9a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.792163 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23954eb4-4a85-4139-bc61-0f019a96ee9a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.792595 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23954eb4-4a85-4139-bc61-0f019a96ee9a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.793505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23954eb4-4a85-4139-bc61-0f019a96ee9a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.793966 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23954eb4-4a85-4139-bc61-0f019a96ee9a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.794379 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-23954eb4-4a85-4139-bc61-0f019a96ee9a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.940444 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-23954eb4-4a85-4139-bc61-0f019a96ee9a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:53.948238 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-23954eb4-4a85-4139-bc61-0f019a96ee9a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1675 microversion: 2.1 time: 0.168137 Sep 08 14:04:53.948980 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 330/655] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:53 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:54.895308 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-deebea00-a052-4066-bd3c-5c74596c6c1c req-0c3c1ccc-b633-4e17-95ea-7cc6f0e3546e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a905c87-01a3-4760-8c5c-7df6b9b7b190", "tag": "98ad18af-5b71-4073-a0f8-4fcd2a13191f"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:54.905802 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-deebea00-a052-4066-bd3c-5c74596c6c1c req-0c3c1ccc-b633-4e17-95ea-7cc6f0e3546e service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:54.906338 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-deebea00-a052-4066-bd3c-5c74596c6c1c req-0c3c1ccc-b633-4e17-95ea-7cc6f0e3546e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:54.906772 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-deebea00-a052-4066-bd3c-5c74596c6c1c req-0c3c1ccc-b633-4e17-95ea-7cc6f0e3546e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:54.918672 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-deebea00-a052-4066-bd3c-5c74596c6c1c req-0c3c1ccc-b633-4e17-95ea-7cc6f0e3546e service nova] Creating event network-changed:98ad18af-5b71-4073-a0f8-4fcd2a13191f for instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 on hv-cinder-84773 Sep 08 14:04:54.924263 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-deebea00-a052-4066-bd3c-5c74596c6c1c req-0c3c1ccc-b633-4e17-95ea-7cc6f0e3546e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033049 Sep 08 14:04:54.924857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 326/656] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:54.972312 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2a4aecb5-e8e9-424c-a776-c56cf992c3cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:54.972931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2a4aecb5-e8e9-424c-a776-c56cf992c3cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:54.979610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2a4aecb5-e8e9-424c-a776-c56cf992c3cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:54.980084 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2a4aecb5-e8e9-424c-a776-c56cf992c3cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:54.980517 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2a4aecb5-e8e9-424c-a776-c56cf992c3cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:54.981193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2a4aecb5-e8e9-424c-a776-c56cf992c3cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:54.981638 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2a4aecb5-e8e9-424c-a776-c56cf992c3cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:54.982054 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2a4aecb5-e8e9-424c-a776-c56cf992c3cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:55.116144 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2a4aecb5-e8e9-424c-a776-c56cf992c3cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:55.123847 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2a4aecb5-e8e9-424c-a776-c56cf992c3cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1675 microversion: 2.1 time: 0.155425 Sep 08 14:04:55.124413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 331/657] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:54 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:56.147409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ca0874b2-940b-4013-bea5-3160582ccf74 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:56.148095 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ca0874b2-940b-4013-bea5-3160582ccf74 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:56.154994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca0874b2-940b-4013-bea5-3160582ccf74 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.155474 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca0874b2-940b-4013-bea5-3160582ccf74 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.155903 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca0874b2-940b-4013-bea5-3160582ccf74 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.156588 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca0874b2-940b-4013-bea5-3160582ccf74 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.157041 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca0874b2-940b-4013-bea5-3160582ccf74 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.157455 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca0874b2-940b-4013-bea5-3160582ccf74 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.291484 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ca0874b2-940b-4013-bea5-3160582ccf74 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:56.302568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ca0874b2-940b-4013-bea5-3160582ccf74 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1675 microversion: 2.1 time: 0.159247 Sep 08 14:04:56.303394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 327/658] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:56 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:57.328746 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a97ccf47-3870-41fc-8137-1d147c887b0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:57.329353 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a97ccf47-3870-41fc-8137-1d147c887b0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:57.335866 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a97ccf47-3870-41fc-8137-1d147c887b0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:57.336302 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a97ccf47-3870-41fc-8137-1d147c887b0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:57.336732 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a97ccf47-3870-41fc-8137-1d147c887b0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:57.337427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a97ccf47-3870-41fc-8137-1d147c887b0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:57.337880 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a97ccf47-3870-41fc-8137-1d147c887b0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:57.338391 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a97ccf47-3870-41fc-8137-1d147c887b0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:57.470016 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a97ccf47-3870-41fc-8137-1d147c887b0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:57.477897 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a97ccf47-3870-41fc-8137-1d147c887b0c tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1675 microversion: 2.1 time: 0.153185 Sep 08 14:04:57.478470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 332/659] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:57 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:57.858211 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-9afd88a1-7872-413e-80a8-ef4c13077692 req-6380dbbd-88a9-42a6-a0d9-7bd087dbfc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6194e5e-54c1-4f8b-a021-be476c67c25e", "name": "network-vif-deleted", "tag": "e7a74814-4bc9-432b-b4e2-e2d33d383b16"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:57.869306 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-9afd88a1-7872-413e-80a8-ef4c13077692 req-6380dbbd-88a9-42a6-a0d9-7bd087dbfc4d service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:57.869783 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-9afd88a1-7872-413e-80a8-ef4c13077692 req-6380dbbd-88a9-42a6-a0d9-7bd087dbfc4d service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:57.870202 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-9afd88a1-7872-413e-80a8-ef4c13077692 req-6380dbbd-88a9-42a6-a0d9-7bd087dbfc4d service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:57.882873 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-9afd88a1-7872-413e-80a8-ef4c13077692 req-6380dbbd-88a9-42a6-a0d9-7bd087dbfc4d service nova] Creating event network-vif-deleted:e7a74814-4bc9-432b-b4e2-e2d33d383b16 for instance e6194e5e-54c1-4f8b-a021-be476c67c25e on hv-cinder-84773 Sep 08 14:04:57.888027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-9afd88a1-7872-413e-80a8-ef4c13077692 req-6380dbbd-88a9-42a6-a0d9-7bd087dbfc4d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033557 Sep 08 14:04:57.888978 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 328/660] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:58.501719 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:58.502326 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:58.509097 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.509599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.510109 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.510717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.511200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.511894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.548906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.549498 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.550042 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.550558 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lazy-loading 'fault' on Instance uuid e6194e5e-54c1-4f8b-a021-be476c67c25e {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:04:58.599405 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:58.607555 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6c3e620e-5218-4944-9ece-247bd1d527ae tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 200 len: 1328 microversion: 2.1 time: 0.109634 Sep 08 14:04:58.608415 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 333/661] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:58 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:59.633826 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:59.634439 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:59.640928 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:59.648282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:59.648282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:59.648282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:59.648282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:59.648921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:59.657754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] HTTP exception thrown: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Request method failure captured: Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e HTTP/1.1 Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVW0XblqzpKmD2u__hW2kio_fYuPre3cdiVNc1KOI02xERtcRS_DW5g-pUqNQxzC1Iaoj3qt_Px8yIWJBNdKjP5HdvYGhc_yB6dVQqSLuxkKWTvf56A5lJQpk9nVErxCKwceaG15aRC1IF6njBqK4-MhF2EKwi9O6hPNNch_WuBjr0 Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:04:59.659493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_4d0ed4e4f54c47369721e871f0dec518", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 7b403bdc9cad4783b72bbf174199363c Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:04:59.661125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': 'e6194e5e-54c1-4f8b-a021-be476c67c25e'} Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:04:59.662050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:04:59.663644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:04:59.665239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Returning 404 to user: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:04:59.665239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-28f454b5-7a20-4a75-8588-c3184e137f3e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 404 len: 111 microversion: 2.1 time: 0.032216 Sep 08 14:04:59.665239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 329/662] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:59 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:04:59.670494 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-20908a64-9a48-40a5-8b7e-1775a83765fb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '.version_select at 0x7f51fbf0ea60>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:59.809703 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-20908a64-9a48-40a5-8b7e-1775a83765fb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019235176" status: 202 len: 0 microversion: 2.1 time: 0.143624 Sep 08 14:04:59.810287 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 334/663] 10.222.0.91 () {58 vars in 1221 bytes} [Thu Sep 8 14:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019235176 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:00.665286 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ea605aca-1ba5-4d6d-9675-13a91dff5e28 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'create', calling method: .version_select at 0x7f51fbd4fe50>, body: {"keypair": {"name": "tempest-keypair-872289263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSFFQgUYcP5XECvVQdUP5FWiwHbqr/QOpuIsT/gORKzGSz7RzHsl2fGohVF7/j+9QR5q6VijNyTfkyinNrXXfZ8yZU/QI0CUROicFQusvLuxxWpe4wRaZPl6Q4Qwog8EQ=="}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:00.681972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-ea605aca-1ba5-4d6d-9675-13a91dff5e28 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Getting quotas for project 4d0ed4e4f54c47369721e871f0dec518. Resources: {'key_pairs'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:05:00.685820 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-ea605aca-1ba5-4d6d-9675-13a91dff5e28 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Getting quotas for user 7b403bdc9cad4783b72bbf174199363c and project 4d0ed4e4f54c47369721e871f0dec518. Resources: {'key_pairs'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:05:00.803711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ea605aca-1ba5-4d6d-9675-13a91dff5e28 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142381 Sep 08 14:05:00.807065 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 330/664] 10.222.0.91 () {60 vars in 1159 bytes} [Thu Sep 8 14:05:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:03.478713 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1627620740", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58c8bc7a-6681-4b5a-acdc-437bbe7f81ec"}], "security_groups": [{"name": "tempest-securitygroup--487696845"}], "key_name": "tempest-keypair-872289263", "user_data": "}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:03.586930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] validate_networks() for [('58c8bc7a-6681-4b5a-acdc-437bbe7f81ec', None, None, None, None, None)] {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:05:03.595265 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:05:03.595424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Thu Sep 8 14:05:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.91) !!! Sep 08 14:05:04.015484 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:05:04.015933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:05:04.016431 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:05:04.016836 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:05:04.017264 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:05:04.026483 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:04.027019 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:04.027453 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:04.028173 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:04.028622 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:04.029041 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:04.046810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Getting quotas for project 4d0ed4e4f54c47369721e871f0dec518. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:05:04.051811 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Getting quotas for user 7b403bdc9cad4783b72bbf174199363c and project 4d0ed4e4f54c47369721e871f0dec518. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:05:04.063789 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:05:04.066065 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:05:04.288421 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6fb5a5b4-8b11-4083-827d-ec00b860a9ed tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.815049 Sep 08 14:05:04.289362 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 335/665] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:05:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:05:04.302177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f7a2b1aa-e84f-46b0-b6f4-c56d9160377a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:04.302826 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f7a2b1aa-e84f-46b0-b6f4-c56d9160377a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:04.359154 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f7a2b1aa-e84f-46b0-b6f4-c56d9160377a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:04.366829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f7a2b1aa-e84f-46b0-b6f4-c56d9160377a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1237 microversion: 2.1 time: 0.070060 Sep 08 14:05:04.367520 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 331/666] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:04 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:05.390168 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2302dbb3-87e3-41fc-b415-27f895e327e9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:05.391411 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2302dbb3-87e3-41fc-b415-27f895e327e9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:05.398169 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2302dbb3-87e3-41fc-b415-27f895e327e9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:05.398950 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2302dbb3-87e3-41fc-b415-27f895e327e9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:05.399398 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2302dbb3-87e3-41fc-b415-27f895e327e9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:05.400093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2302dbb3-87e3-41fc-b415-27f895e327e9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:05.400551 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2302dbb3-87e3-41fc-b415-27f895e327e9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:05.400976 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2302dbb3-87e3-41fc-b415-27f895e327e9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:05.463319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2302dbb3-87e3-41fc-b415-27f895e327e9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:05.471059 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2302dbb3-87e3-41fc-b415-27f895e327e9 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1241 microversion: 2.1 time: 0.085277 Sep 08 14:05:05.471643 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 336/667] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:05 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:06.494344 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-00faf263-a895-42f0-a06e-5e0120769f68 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:06.494984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-00faf263-a895-42f0-a06e-5e0120769f68 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:06.501711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00faf263-a895-42f0-a06e-5e0120769f68 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:06.502195 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00faf263-a895-42f0-a06e-5e0120769f68 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:06.502643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00faf263-a895-42f0-a06e-5e0120769f68 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:06.505067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00faf263-a895-42f0-a06e-5e0120769f68 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:06.505067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00faf263-a895-42f0-a06e-5e0120769f68 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:06.505067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00faf263-a895-42f0-a06e-5e0120769f68 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:06.569220 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-00faf263-a895-42f0-a06e-5e0120769f68 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:06.578068 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-00faf263-a895-42f0-a06e-5e0120769f68 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1289 microversion: 2.1 time: 0.087645 Sep 08 14:05:06.578643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 332/668] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:06 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:07.358799 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ad312b31-7bab-4728-8a93-0fc8a5235718 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:07.359412 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ad312b31-7bab-4728-8a93-0fc8a5235718 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:07.366187 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad312b31-7bab-4728-8a93-0fc8a5235718 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.366665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad312b31-7bab-4728-8a93-0fc8a5235718 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.367125 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad312b31-7bab-4728-8a93-0fc8a5235718 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.367805 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad312b31-7bab-4728-8a93-0fc8a5235718 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.368253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad312b31-7bab-4728-8a93-0fc8a5235718 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.368667 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad312b31-7bab-4728-8a93-0fc8a5235718 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.399102 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ad312b31-7bab-4728-8a93-0fc8a5235718 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments/e767ddac-b32f-4c8d-9973-5409ea9c05dd" status: 200 len: 194 microversion: 2.20 time: 0.043849 Sep 08 14:05:07.399597 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 337/669] 10.222.0.91 () {60 vars in 1454 bytes} [Thu Sep 8 14:05:07 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments/e767ddac-b32f-4c8d-9973-5409ea9c05dd => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:05:07.476259 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f373b5d4-cb6e-4ae5-a992-ec199d3d2e02 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:07.476777 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f373b5d4-cb6e-4ae5-a992-ec199d3d2e02 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:07.483182 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f373b5d4-cb6e-4ae5-a992-ec199d3d2e02 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.483716 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f373b5d4-cb6e-4ae5-a992-ec199d3d2e02 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.484227 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f373b5d4-cb6e-4ae5-a992-ec199d3d2e02 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.484932 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f373b5d4-cb6e-4ae5-a992-ec199d3d2e02 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.485389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f373b5d4-cb6e-4ae5-a992-ec199d3d2e02 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.485818 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f373b5d4-cb6e-4ae5-a992-ec199d3d2e02 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.602120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5a422ec4-a02e-4bf1-97f7-3bb77ba808cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:07.602881 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5a422ec4-a02e-4bf1-97f7-3bb77ba808cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:07.615917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a422ec4-a02e-4bf1-97f7-3bb77ba808cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.616505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a422ec4-a02e-4bf1-97f7-3bb77ba808cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.617032 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a422ec4-a02e-4bf1-97f7-3bb77ba808cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.617801 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a422ec4-a02e-4bf1-97f7-3bb77ba808cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.618440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a422ec4-a02e-4bf1-97f7-3bb77ba808cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.619093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a422ec4-a02e-4bf1-97f7-3bb77ba808cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.620155 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-f373b5d4-cb6e-4ae5-a992-ec199d3d2e02 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lazy-loading 'services' on Instance uuid 99ba16ca-2c31-48e8-853e-416c2c3bf1fd {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:07.685929 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5a422ec4-a02e-4bf1-97f7-3bb77ba808cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:07.694660 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5a422ec4-a02e-4bf1-97f7-3bb77ba808cc tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1297 microversion: 2.1 time: 0.096672 Sep 08 14:05:07.695301 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 338/670] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:07 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:08.095524 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f373b5d4-cb6e-4ae5-a992-ec199d3d2e02 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "DELETE /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments/e767ddac-b32f-4c8d-9973-5409ea9c05dd" status: 202 len: 0 microversion: 2.20 time: 0.623242 Sep 08 14:05:08.100967 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 333/671] 10.222.0.91 () {60 vars in 1457 bytes} [Thu Sep 8 14:05:07 2022] DELETE /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments/e767ddac-b32f-4c8d-9973-5409ea9c05dd => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:05:08.106779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-88d6f9e2-6c42-49a5-9295-42777d9d2854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:08.110192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-88d6f9e2-6c42-49a5-9295-42777d9d2854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:08.117448 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88d6f9e2-6c42-49a5-9295-42777d9d2854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.118068 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88d6f9e2-6c42-49a5-9295-42777d9d2854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.118604 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88d6f9e2-6c42-49a5-9295-42777d9d2854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.119429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88d6f9e2-6c42-49a5-9295-42777d9d2854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.120167 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88d6f9e2-6c42-49a5-9295-42777d9d2854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.120681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-88d6f9e2-6c42-49a5-9295-42777d9d2854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.154280 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-88d6f9e2-6c42-49a5-9295-42777d9d2854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051698 Sep 08 14:05:08.155196 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 339/672] 10.222.0.91 () {60 vars in 1343 bytes} [Thu Sep 8 14:05:08 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:05:08.724009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b99a6c0b-6fe8-4754-866b-bddc3d82270d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:08.724804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b99a6c0b-6fe8-4754-866b-bddc3d82270d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:08.732077 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b99a6c0b-6fe8-4754-866b-bddc3d82270d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.732565 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b99a6c0b-6fe8-4754-866b-bddc3d82270d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.733005 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b99a6c0b-6fe8-4754-866b-bddc3d82270d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.734065 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b99a6c0b-6fe8-4754-866b-bddc3d82270d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.734521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b99a6c0b-6fe8-4754-866b-bddc3d82270d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.734967 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b99a6c0b-6fe8-4754-866b-bddc3d82270d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.878702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b99a6c0b-6fe8-4754-866b-bddc3d82270d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:08.892166 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b99a6c0b-6fe8-4754-866b-bddc3d82270d tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.167769 Sep 08 14:05:08.892166 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 334/673] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:08 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:09.167737 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b868c7e9-1c1d-4a48-a97c-191e6afc5fb2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:09.169918 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b868c7e9-1c1d-4a48-a97c-191e6afc5fb2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:09.177945 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b868c7e9-1c1d-4a48-a97c-191e6afc5fb2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.178362 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b868c7e9-1c1d-4a48-a97c-191e6afc5fb2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.179989 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b868c7e9-1c1d-4a48-a97c-191e6afc5fb2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:09.180953 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b868c7e9-1c1d-4a48-a97c-191e6afc5fb2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.181411 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b868c7e9-1c1d-4a48-a97c-191e6afc5fb2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.181833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b868c7e9-1c1d-4a48-a97c-191e6afc5fb2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:09.216761 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b868c7e9-1c1d-4a48-a97c-191e6afc5fb2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053106 Sep 08 14:05:09.223666 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 340/674] 10.222.0.91 () {60 vars in 1343 bytes} [Thu Sep 8 14:05:09 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:05:09.912624 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-72ef8c66-2946-4843-9892-ceee901f5a6b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:09.913400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-72ef8c66-2946-4843-9892-ceee901f5a6b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:09.921484 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-72ef8c66-2946-4843-9892-ceee901f5a6b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.923865 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-72ef8c66-2946-4843-9892-ceee901f5a6b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.923865 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-72ef8c66-2946-4843-9892-ceee901f5a6b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:09.924382 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-72ef8c66-2946-4843-9892-ceee901f5a6b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.925169 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-72ef8c66-2946-4843-9892-ceee901f5a6b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.925896 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-72ef8c66-2946-4843-9892-ceee901f5a6b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:09.948276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-939d038a-6940-4d6b-bf8b-01142c8b0e72 req-8c738d96-3d99-403b-a348-e31b30e2a8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02257583-1cd3-4c60-9fd9-72bd2c16425e", "tag": "49ca98e0-9d14-4595-804a-6e918c13b9f0"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:09.959101 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-939d038a-6940-4d6b-bf8b-01142c8b0e72 req-8c738d96-3d99-403b-a348-e31b30e2a8c9 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.959684 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-939d038a-6940-4d6b-bf8b-01142c8b0e72 req-8c738d96-3d99-403b-a348-e31b30e2a8c9 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.960349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-939d038a-6940-4d6b-bf8b-01142c8b0e72 req-8c738d96-3d99-403b-a348-e31b30e2a8c9 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:09.972123 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-939d038a-6940-4d6b-bf8b-01142c8b0e72 req-8c738d96-3d99-403b-a348-e31b30e2a8c9 service nova] Creating event network-changed:49ca98e0-9d14-4595-804a-6e918c13b9f0 for instance 02257583-1cd3-4c60-9fd9-72bd2c16425e on hv-cinder-84773 Sep 08 14:05:09.977438 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-939d038a-6940-4d6b-bf8b-01142c8b0e72 req-8c738d96-3d99-403b-a348-e31b30e2a8c9 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035977 Sep 08 14:05:09.978164 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 341/675] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:10.138781 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-72ef8c66-2946-4843-9892-ceee901f5a6b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:10.147795 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-72ef8c66-2946-4843-9892-ceee901f5a6b tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.240419 Sep 08 14:05:10.148378 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 335/676] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:09 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:10.231047 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-060456ed-5720-4c59-9fe4-58f36e507ac5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:10.233318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-060456ed-5720-4c59-9fe4-58f36e507ac5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:10.240461 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-060456ed-5720-4c59-9fe4-58f36e507ac5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:10.240952 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-060456ed-5720-4c59-9fe4-58f36e507ac5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:10.241528 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-060456ed-5720-4c59-9fe4-58f36e507ac5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:10.242303 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-060456ed-5720-4c59-9fe4-58f36e507ac5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:10.242752 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-060456ed-5720-4c59-9fe4-58f36e507ac5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:10.243203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-060456ed-5720-4c59-9fe4-58f36e507ac5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:10.277253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-060456ed-5720-4c59-9fe4-58f36e507ac5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051169 Sep 08 14:05:10.277859 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 342/677] 10.222.0.91 () {60 vars in 1343 bytes} [Thu Sep 8 14:05:10 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:10.346193 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-80832a84-5804-412d-81a1-ffdd6347c664 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:10.346679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-80832a84-5804-412d-81a1-ffdd6347c664 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:10.352918 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80832a84-5804-412d-81a1-ffdd6347c664 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:10.353402 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80832a84-5804-412d-81a1-ffdd6347c664 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:10.353828 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80832a84-5804-412d-81a1-ffdd6347c664 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:10.355241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80832a84-5804-412d-81a1-ffdd6347c664 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:10.355241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80832a84-5804-412d-81a1-ffdd6347c664 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:10.355587 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-80832a84-5804-412d-81a1-ffdd6347c664 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:10.383768 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-80832a84-5804-412d-81a1-ffdd6347c664 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Going to try to terminate instance {{(pid=133059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:10.420370 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:10.889145 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-80832a84-5804-412d-81a1-ffdd6347c664 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "DELETE /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 204 len: 0 microversion: 2.20 time: 0.546584 Sep 08 14:05:10.889736 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 336/678] 10.222.0.91 () {60 vars in 1280 bytes} [Thu Sep 8 14:05:10 2022] DELETE /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 14:05:10.901628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:10.902232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:10.908296 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:10.908783 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:10.909215 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:10.909907 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:10.910846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:10.911296 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:10.932216 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:11.054840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:11.063831 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:11.065279 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:11.066432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ef270c20-4069-4f35-93cc-c0da737a8659 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.168922 Sep 08 14:05:11.066999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 343/679] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:10 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:11.172250 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2bbd896c-4843-4441-9ce5-bb573693da95 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:11.172942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2bbd896c-4843-4441-9ce5-bb573693da95 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:11.179815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbd896c-4843-4441-9ce5-bb573693da95 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:11.180295 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbd896c-4843-4441-9ce5-bb573693da95 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:11.180727 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbd896c-4843-4441-9ce5-bb573693da95 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:11.181414 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbd896c-4843-4441-9ce5-bb573693da95 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:11.181864 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbd896c-4843-4441-9ce5-bb573693da95 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:11.182283 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2bbd896c-4843-4441-9ce5-bb573693da95 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:11.321057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2bbd896c-4843-4441-9ce5-bb573693da95 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:11.328788 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2bbd896c-4843-4441-9ce5-bb573693da95 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.161270 Sep 08 14:05:11.329384 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 337/680] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:11 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:12.092574 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:12.093195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:12.100350 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:12.100825 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:12.101254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:12.101940 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:12.102383 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:12.102796 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:12.233593 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:12.243553 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:12.245035 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:12.246366 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d8cac916-a76d-4117-891c-c207b6f02160 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.157756 Sep 08 14:05:12.246968 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 344/681] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:12 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:12.352697 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-fa479cd8-3dde-46bd-9d75-805f4fe11e2e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:12.353253 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-fa479cd8-3dde-46bd-9d75-805f4fe11e2e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:12.359809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa479cd8-3dde-46bd-9d75-805f4fe11e2e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:12.360290 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa479cd8-3dde-46bd-9d75-805f4fe11e2e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:12.360715 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa479cd8-3dde-46bd-9d75-805f4fe11e2e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:12.361398 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa479cd8-3dde-46bd-9d75-805f4fe11e2e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:12.361837 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa479cd8-3dde-46bd-9d75-805f4fe11e2e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:12.362252 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fa479cd8-3dde-46bd-9d75-805f4fe11e2e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:12.561450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-fa479cd8-3dde-46bd-9d75-805f4fe11e2e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:12.569219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-fa479cd8-3dde-46bd-9d75-805f4fe11e2e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.220435 Sep 08 14:05:12.569789 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 338/682] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:12 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:13.272262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:13.272897 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:13.279712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.280200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.280634 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.281353 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.281807 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.282231 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.413674 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:13.421805 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:13.423295 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:13.424480 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-69755952-16d6-4c60-9fa1-dbfec97ab3ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1721 microversion: 2.20 time: 0.156982 Sep 08 14:05:13.425055 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 345/683] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:13 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:13.592861 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5fd0f651-addc-4b93-aa94-ba43086837c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:13.593456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5fd0f651-addc-4b93-aa94-ba43086837c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:13.599840 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fd0f651-addc-4b93-aa94-ba43086837c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.600322 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fd0f651-addc-4b93-aa94-ba43086837c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.600744 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fd0f651-addc-4b93-aa94-ba43086837c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.601424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fd0f651-addc-4b93-aa94-ba43086837c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.601867 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fd0f651-addc-4b93-aa94-ba43086837c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.602279 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5fd0f651-addc-4b93-aa94-ba43086837c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.736188 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5fd0f651-addc-4b93-aa94-ba43086837c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:13.745011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5fd0f651-addc-4b93-aa94-ba43086837c1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.156040 Sep 08 14:05:13.748201 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 339/684] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:13 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:14.453225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:14.453652 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:14.455330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:14.456013 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=6 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:14.461464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.461957 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.462392 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.463317 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.463772 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.464224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.536280 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:14.545078 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:14.546624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:14.547828 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-89c9feda-2cce-4c7c-952a-7d301454bb28 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1654 microversion: 2.20 time: 0.100915 Sep 08 14:05:14.548387 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 346/685] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:14 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1654 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:14.625479 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8ff93ca5-b0e5-40ea-afcd-afcd2884e8a9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1263109879"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:14.626139 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8ff93ca5-b0e5-40ea-afcd-afcd2884e8a9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:14.628675 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=6 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:14.633939 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ff93ca5-b0e5-40ea-afcd-afcd2884e8a9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.634429 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ff93ca5-b0e5-40ea-afcd-afcd2884e8a9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.634860 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ff93ca5-b0e5-40ea-afcd-afcd2884e8a9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.635581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ff93ca5-b0e5-40ea-afcd-afcd2884e8a9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.636036 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ff93ca5-b0e5-40ea-afcd-afcd2884e8a9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.636454 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ff93ca5-b0e5-40ea-afcd-afcd2884e8a9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.740909 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-64a7d199-50f1-4188-afbd-a5b5e549636a req-fe7aacff-d256-4fef-8a6c-ca78fb39a6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ba16ca-2c31-48e8-853e-416c2c3bf1fd", "name": "network-vif-deleted", "tag": "e0a16b6f-cb62-4645-9c10-fa91d5e04946"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:14.752332 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-64a7d199-50f1-4188-afbd-a5b5e549636a req-fe7aacff-d256-4fef-8a6c-ca78fb39a6e9 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.752910 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-64a7d199-50f1-4188-afbd-a5b5e549636a req-fe7aacff-d256-4fef-8a6c-ca78fb39a6e9 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.759480 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-64a7d199-50f1-4188-afbd-a5b5e549636a req-fe7aacff-d256-4fef-8a6c-ca78fb39a6e9 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.768428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-64a7d199-50f1-4188-afbd-a5b5e549636a req-fe7aacff-d256-4fef-8a6c-ca78fb39a6e9 service nova] Creating event network-vif-deleted:e0a16b6f-cb62-4645-9c10-fa91d5e04946 for instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd on hv-cinder-84773 Sep 08 14:05:14.774812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-64a7d199-50f1-4188-afbd-a5b5e549636a req-fe7aacff-d256-4fef-8a6c-ca78fb39a6e9 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037582 Sep 08 14:05:14.775849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 347/686] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:14.780900 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5c1f50fc-f6d9-4587-9f07-8858d2c22037 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:14.781707 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5c1f50fc-f6d9-4587-9f07-8858d2c22037 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:14.791363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c1f50fc-f6d9-4587-9f07-8858d2c22037 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.791930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c1f50fc-f6d9-4587-9f07-8858d2c22037 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.792506 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c1f50fc-f6d9-4587-9f07-8858d2c22037 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.793412 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c1f50fc-f6d9-4587-9f07-8858d2c22037 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.794018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c1f50fc-f6d9-4587-9f07-8858d2c22037 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.794629 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c1f50fc-f6d9-4587-9f07-8858d2c22037 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.859499 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.network.security_group_api [None req-8ff93ca5-b0e5-40ea-afcd-afcd2884e8a9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Removing security group 1fbcf4ad-61f7-4d3a-bc49-9be81697fc49 from port 8d168477-404b-4ddb-8747-6423a9c84ab9 Sep 08 14:05:14.989079 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5c1f50fc-f6d9-4587-9f07-8858d2c22037 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:15.002800 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5c1f50fc-f6d9-4587-9f07-8858d2c22037 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.225816 Sep 08 14:05:15.004622 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 348/687] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:14 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:15.304885 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8ff93ca5-b0e5-40ea-afcd-afcd2884e8a9 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "POST /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/action" status: 202 len: 0 microversion: 2.1 time: 0.683264 Sep 08 14:05:15.305611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 340/688] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:05:14 2022] POST /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:15.575194 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:15.576602 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:15.585390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:15.586071 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:15.586714 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:15.587927 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:15.588850 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:15.589468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:15.632353 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:15.632865 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:15.633354 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:15.633813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lazy-loading 'fault' on Instance uuid 99ba16ca-2c31-48e8-853e-416c2c3bf1fd {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:15.728401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:15.740372 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:15.740372 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:15.740843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e2b07d66-7923-4986-ad1f-0bd09331513e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 200 len: 1370 microversion: 2.20 time: 0.171576 Sep 08 14:05:15.741383 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 349/689] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:15 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:16.027194 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-433e8f73-8fc3-4c50-a4d8-f1092a2c0124 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:16.027805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-433e8f73-8fc3-4c50-a4d8-f1092a2c0124 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:16.033920 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-433e8f73-8fc3-4c50-a4d8-f1092a2c0124 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:16.034481 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-433e8f73-8fc3-4c50-a4d8-f1092a2c0124 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:16.035208 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-433e8f73-8fc3-4c50-a4d8-f1092a2c0124 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:16.036331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-433e8f73-8fc3-4c50-a4d8-f1092a2c0124 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:16.036814 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-433e8f73-8fc3-4c50-a4d8-f1092a2c0124 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:16.037244 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-433e8f73-8fc3-4c50-a4d8-f1092a2c0124 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:16.196185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-433e8f73-8fc3-4c50-a4d8-f1092a2c0124 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:16.204002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-433e8f73-8fc3-4c50-a4d8-f1092a2c0124 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.181571 Sep 08 14:05:16.204819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 341/690] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:16 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:16.676341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-83313447-68a0-4a79-8f88-5a0b3c5f5939 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:16.676889 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-83313447-68a0-4a79-8f88-5a0b3c5f5939 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:16.683195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-83313447-68a0-4a79-8f88-5a0b3c5f5939 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:16.683685 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-83313447-68a0-4a79-8f88-5a0b3c5f5939 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:16.684118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-83313447-68a0-4a79-8f88-5a0b3c5f5939 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:16.684878 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-83313447-68a0-4a79-8f88-5a0b3c5f5939 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:16.685330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-83313447-68a0-4a79-8f88-5a0b3c5f5939 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:16.685749 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-83313447-68a0-4a79-8f88-5a0b3c5f5939 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:16.766626 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:16.767497 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:16.775623 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:16.776670 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:16.777622 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:16.778732 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-83313447-68a0-4a79-8f88-5a0b3c5f5939 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lazy-loading 'services' on Instance uuid 5fe93656-bec8-4094-9b98-062302018a59 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:16.778923 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:16.779422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:16.779951 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] HTTP exception thrown: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Request method failure captured: Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd HTTP/1.1 Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfXJ5WP7P5luFw8v6lGcMvripLPXxFA2OYW7phQDyBxZXZ8bgHJGvPsJMNlRoWctBWZhpTI-cZ_vbjGlQxuQIxrUCilA05GJqjHbxn6RBDJZgtZW22ASMfF-Newb_4L8zNKPoj45Z7gDysZfBUpP2jR326gFGBFpruHHkOq1Du6Q5UQ Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:05:16.819703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_a9448ca7c8234f74b24c8f6710a0ef5c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 48bf6dab289545bb80182c8904c05d6c Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:05:16.821645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '99ba16ca-2c31-48e8-853e-416c2c3bf1fd'} Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:16.822389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:05:16.823654 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:16.824740 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Returning 404 to user: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:16.824740 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-06f2cef9-0da9-4945-a7ac-ec34625b9919 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 404 len: 111 microversion: 2.20 time: 0.044395 Sep 08 14:05:16.824740 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 342/691] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:16 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:05:16.824740 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-8638ef1d-9f83-4239-94c7-7f4accdf6bf8 req-aad987e7-cf83-49af-954c-4f833ef40df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe93656-bec8-4094-9b98-062302018a59", "tag": "8d168477-404b-4ddb-8747-6423a9c84ab9"}, {"name": "network-changed", "server_uuid": "5fe93656-bec8-4094-9b98-062302018a59", "tag": "8d168477-404b-4ddb-8747-6423a9c84ab9"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:16.825032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-8638ef1d-9f83-4239-94c7-7f4accdf6bf8 req-aad987e7-cf83-49af-954c-4f833ef40df7 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:16.825032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-8638ef1d-9f83-4239-94c7-7f4accdf6bf8 req-aad987e7-cf83-49af-954c-4f833ef40df7 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:16.825032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-8638ef1d-9f83-4239-94c7-7f4accdf6bf8 req-aad987e7-cf83-49af-954c-4f833ef40df7 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:16.834869 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-8638ef1d-9f83-4239-94c7-7f4accdf6bf8 req-aad987e7-cf83-49af-954c-4f833ef40df7 service nova] Creating event network-changed:8d168477-404b-4ddb-8747-6423a9c84ab9 for instance 5fe93656-bec8-4094-9b98-062302018a59 on hv-cinder-84773 Sep 08 14:05:16.835512 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-8638ef1d-9f83-4239-94c7-7f4accdf6bf8 req-aad987e7-cf83-49af-954c-4f833ef40df7 service nova] Creating event network-changed:8d168477-404b-4ddb-8747-6423a9c84ab9 for instance 5fe93656-bec8-4094-9b98-062302018a59 on hv-cinder-84773 Sep 08 14:05:16.840813 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-8638ef1d-9f83-4239-94c7-7f4accdf6bf8 req-aad987e7-cf83-49af-954c-4f833ef40df7 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032100 Sep 08 14:05:16.841732 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 343/692] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:16.846885 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b8d65dcd-6d6e-489f-96ac-049488e190c7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '.version_select at 0x7f51fbd41c10>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:17.000471 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b8d65dcd-6d6e-489f-96ac-049488e190c7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288998548" status: 204 len: 0 microversion: 2.20 time: 0.156947 Sep 08 14:05:17.002801 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 344/693] 10.222.0.91 () {60 vars in 1259 bytes} [Thu Sep 8 14:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288998548 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 14:05:17.185795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-83313447-68a0-4a79-8f88-5a0b3c5f5939 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments/b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb" status: 202 len: 0 microversion: 2.1 time: 0.513326 Sep 08 14:05:17.186497 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 350/694] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:05:16 2022] DELETE /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments/b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:17.196206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7a067f9e-b2aa-4db5-afa8-8293dfe1f8dc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:17.199521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7a067f9e-b2aa-4db5-afa8-8293dfe1f8dc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:17.206768 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a067f9e-b2aa-4db5-afa8-8293dfe1f8dc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:17.207622 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a067f9e-b2aa-4db5-afa8-8293dfe1f8dc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:17.208291 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a067f9e-b2aa-4db5-afa8-8293dfe1f8dc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:17.209059 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a067f9e-b2aa-4db5-afa8-8293dfe1f8dc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:17.209729 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a067f9e-b2aa-4db5-afa8-8293dfe1f8dc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:17.210310 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7a067f9e-b2aa-4db5-afa8-8293dfe1f8dc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:17.237184 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ffd53c5a-e335-431d-9a27-605649d607c8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:17.239863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ffd53c5a-e335-431d-9a27-605649d607c8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:17.244253 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7a067f9e-b2aa-4db5-afa8-8293dfe1f8dc tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052897 Sep 08 14:05:17.245223 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 345/695] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:17 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:17.248915 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ffd53c5a-e335-431d-9a27-605649d607c8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:17.253304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ffd53c5a-e335-431d-9a27-605649d607c8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:17.253304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ffd53c5a-e335-431d-9a27-605649d607c8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:17.253304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ffd53c5a-e335-431d-9a27-605649d607c8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:17.253304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ffd53c5a-e335-431d-9a27-605649d607c8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:17.253642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ffd53c5a-e335-431d-9a27-605649d607c8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:17.456789 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ffd53c5a-e335-431d-9a27-605649d607c8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:17.470993 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ffd53c5a-e335-431d-9a27-605649d607c8 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.243878 Sep 08 14:05:17.472113 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 351/696] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:17 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:18.257809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0f6731b4-4514-43ff-b2cf-02bd40c69140 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:18.260702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0f6731b4-4514-43ff-b2cf-02bd40c69140 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:18.267179 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f6731b4-4514-43ff-b2cf-02bd40c69140 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.267979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f6731b4-4514-43ff-b2cf-02bd40c69140 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.268571 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f6731b4-4514-43ff-b2cf-02bd40c69140 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.269351 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f6731b4-4514-43ff-b2cf-02bd40c69140 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.269904 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f6731b4-4514-43ff-b2cf-02bd40c69140 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.270435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0f6731b4-4514-43ff-b2cf-02bd40c69140 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.309262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0f6731b4-4514-43ff-b2cf-02bd40c69140 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055889 Sep 08 14:05:18.316245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 346/697] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:18 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:18.326559 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-96d01351-1b7b-4ed3-a82b-122b490522e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Action: 'create', calling method: .version_select at 0x7f51fbe50310>, body: {"keypair": {"name": "tempest-keypair-281384556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBKs9x4FtO3vu3L27EQOoXEWSefADd/ksomt/wk5CnWS7AaBhYUVbe168NGz5k25FCvAVZO7HtiDMtULUly49E1LZssf/EYr4OmhAncUn3GkMKhKDybpHe4V1Mjx02QA=="}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:18.332723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:18.344123 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-96d01351-1b7b-4ed3-a82b-122b490522e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Getting quotas for project a9448ca7c8234f74b24c8f6710a0ef5c. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:05:18.348567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-96d01351-1b7b-4ed3-a82b-122b490522e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Getting quotas for user 48bf6dab289545bb80182c8904c05d6c and project a9448ca7c8234f74b24c8f6710a0ef5c. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:05:18.412233 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-d7c92888-9486-4e43-8641-0e2b03d3fae2 req-e63ac8d7-9b9e-412e-893d-f296310a430b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02257583-1cd3-4c60-9fd9-72bd2c16425e", "name": "network-vif-plugged", "status": "completed", "tag": "49ca98e0-9d14-4595-804a-6e918c13b9f0"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:18.421477 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-d7c92888-9486-4e43-8641-0e2b03d3fae2 req-e63ac8d7-9b9e-412e-893d-f296310a430b service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.421952 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-d7c92888-9486-4e43-8641-0e2b03d3fae2 req-e63ac8d7-9b9e-412e-893d-f296310a430b service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.422380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-d7c92888-9486-4e43-8641-0e2b03d3fae2 req-e63ac8d7-9b9e-412e-893d-f296310a430b service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.433764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-d7c92888-9486-4e43-8641-0e2b03d3fae2 req-e63ac8d7-9b9e-412e-893d-f296310a430b service nova] Creating event network-vif-plugged:49ca98e0-9d14-4595-804a-6e918c13b9f0 for instance 02257583-1cd3-4c60-9fd9-72bd2c16425e on hv-cinder-84773 Sep 08 14:05:18.438595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-d7c92888-9486-4e43-8641-0e2b03d3fae2 req-e63ac8d7-9b9e-412e-893d-f296310a430b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030056 Sep 08 14:05:18.439341 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 347/698] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:18.499594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d7a90fd0-3616-48f8-b3d4-3feab7511262 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:18.500278 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d7a90fd0-3616-48f8-b3d4-3feab7511262 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:18.507775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-96d01351-1b7b-4ed3-a82b-122b490522e1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.185165 Sep 08 14:05:18.508128 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a90fd0-3616-48f8-b3d4-3feab7511262 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.508692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 352/699] 10.222.0.91 () {62 vars in 1200 bytes} [Thu Sep 8 14:05:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 14:05:18.508833 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a90fd0-3616-48f8-b3d4-3feab7511262 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.509036 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a90fd0-3616-48f8-b3d4-3feab7511262 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.509741 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a90fd0-3616-48f8-b3d4-3feab7511262 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.510186 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a90fd0-3616-48f8-b3d4-3feab7511262 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.510785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d7a90fd0-3616-48f8-b3d4-3feab7511262 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.686211 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d7a90fd0-3616-48f8-b3d4-3feab7511262 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:18.695670 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d7a90fd0-3616-48f8-b3d4-3feab7511262 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.200271 Sep 08 14:05:18.696464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 348/700] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:18 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:19.331862 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d2557be9-7ac6-4907-81b1-51c8d2a0e6b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:19.334083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d2557be9-7ac6-4907-81b1-51c8d2a0e6b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:19.341589 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2557be9-7ac6-4907-81b1-51c8d2a0e6b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.342068 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2557be9-7ac6-4907-81b1-51c8d2a0e6b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.342501 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2557be9-7ac6-4907-81b1-51c8d2a0e6b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.343215 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2557be9-7ac6-4907-81b1-51c8d2a0e6b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.343665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2557be9-7ac6-4907-81b1-51c8d2a0e6b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.344089 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2557be9-7ac6-4907-81b1-51c8d2a0e6b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.372989 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d2557be9-7ac6-4907-81b1-51c8d2a0e6b4 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045608 Sep 08 14:05:19.373539 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 353/701] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:19 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:05:19.387803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:19.388316 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:19.394921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.395411 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.395879 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.396604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.397065 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.397490 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.488154 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] HTTP exception thrown: Instance 5fe93656-bec8-4094-9b98-062302018a59 is not attached to volume b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Request method failure captured: Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: DELETE /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments/b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb HTTP/1.1 Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfX4gxCG_KBvNbcoFwCWK8tgIbRf6tLqWjzmqYnyXsPcE2eJHw45Oxp7PIS98a_0_gHwFhYIz0fg6KYhvwABlGmScOSKJ4YMnY1IiU5EYH337nd985aW60qehRMT9TKTi5YKQkfgAzclG1rk4rnMa4OiiTEX9McEc-ttsJE66mPjGYE Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: c533fdd2bf51465792fc266cefeb58f7 Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-TestMinimumBasicScenario-390734584 Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:05:19.491271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c533fdd2bf51465792fc266cefeb58f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c533fdd2bf51465792fc266cefeb58f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c533fdd2bf51465792fc266cefeb58f7", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c533fdd2bf51465792fc266cefeb58f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-TestMinimumBasicScenario-390734584 Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: c533fdd2bf51465792fc266cefeb58f7 Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-TestMinimumBasicScenario-390734584 Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-TestMinimumBasicScenario-390734584-project Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 29c2921e57dc44d2b6d334e88baae0cd Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-TestMinimumBasicScenario-390734584-project Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:05:19.492766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 5fe93656-bec8-4094-9b98-062302018a59 is not attached to volume b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'server_id': '5fe93656-bec8-4094-9b98-062302018a59', 'id': 'b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb'} Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb. Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:19.493568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe93656-bec8-4094-9b98-062302018a59 is not attached to volume b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe93656-bec8-4094-9b98-062302018a59 is not attached to volume b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:19.494942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Returning 404 to user: Instance 5fe93656-bec8-4094-9b98-062302018a59 is not attached to volume b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:19.496677 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2a3bc87d-e3c5-44dd-b1cc-546973e7d330 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments/b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb" status: 404 len: 154 microversion: 2.1 time: 0.110632 Sep 08 14:05:19.496677 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 349/702] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:05:19 2022] DELETE /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59/os-volume_attachments/b50bfa2f-e5cb-4133-99ee-8c4deb79ebdb => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:19.634072 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-81a91f26-fd78-47db-9ca7-0676287be9e4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:19.634572 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-81a91f26-fd78-47db-9ca7-0676287be9e4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:19.640465 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81a91f26-fd78-47db-9ca7-0676287be9e4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.640951 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81a91f26-fd78-47db-9ca7-0676287be9e4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.641383 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81a91f26-fd78-47db-9ca7-0676287be9e4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.642138 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81a91f26-fd78-47db-9ca7-0676287be9e4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.642524 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81a91f26-fd78-47db-9ca7-0676287be9e4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.642963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81a91f26-fd78-47db-9ca7-0676287be9e4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.667310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-81a91f26-fd78-47db-9ca7-0676287be9e4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/ips" status: 200 len: 149 microversion: 2.1 time: 0.096527 Sep 08 14:05:19.668259 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 354/703] 10.222.0.91 () {58 vars in 1248 bytes} [Thu Sep 8 14:05:19 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:19.718581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-817ab1bf-e246-4d48-b446-a08ff3238580 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:19.719223 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-817ab1bf-e246-4d48-b446-a08ff3238580 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:19.726005 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-817ab1bf-e246-4d48-b446-a08ff3238580 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.726489 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-817ab1bf-e246-4d48-b446-a08ff3238580 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.726941 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-817ab1bf-e246-4d48-b446-a08ff3238580 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.727637 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-817ab1bf-e246-4d48-b446-a08ff3238580 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.728090 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-817ab1bf-e246-4d48-b446-a08ff3238580 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.728510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-817ab1bf-e246-4d48-b446-a08ff3238580 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.879536 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-817ab1bf-e246-4d48-b446-a08ff3238580 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:19.887513 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-817ab1bf-e246-4d48-b446-a08ff3238580 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.172843 Sep 08 14:05:19.888071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 350/704] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:19 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:20.910678 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-edf79da1-d263-4351-88cc-65ae216ef025 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:20.910678 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-edf79da1-d263-4351-88cc-65ae216ef025 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:20.914360 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8f7f4c19-b651-4edc-bf92-89c953355b98 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:20.916954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8f7f4c19-b651-4edc-bf92-89c953355b98 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:20.919129 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-edf79da1-d263-4351-88cc-65ae216ef025 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:20.920379 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-edf79da1-d263-4351-88cc-65ae216ef025 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:20.920833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-edf79da1-d263-4351-88cc-65ae216ef025 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:20.921469 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-edf79da1-d263-4351-88cc-65ae216ef025 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:20.922080 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-edf79da1-d263-4351-88cc-65ae216ef025 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:20.922653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-edf79da1-d263-4351-88cc-65ae216ef025 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:20.928110 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f7f4c19-b651-4edc-bf92-89c953355b98 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:20.928877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f7f4c19-b651-4edc-bf92-89c953355b98 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:20.929490 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f7f4c19-b651-4edc-bf92-89c953355b98 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:20.930364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f7f4c19-b651-4edc-bf92-89c953355b98 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:20.930843 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f7f4c19-b651-4edc-bf92-89c953355b98 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:20.931317 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f7f4c19-b651-4edc-bf92-89c953355b98 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:20.955484 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-edf79da1-d263-4351-88cc-65ae216ef025 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:21.084291 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8f7f4c19-b651-4edc-bf92-89c953355b98 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:21.094531 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8f7f4c19-b651-4edc-bf92-89c953355b98 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1362 microversion: 2.1 time: 0.186557 Sep 08 14:05:21.105812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 351/705] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:20 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:21.539760 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-edf79da1-d263-4351-88cc-65ae216ef025 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 204 len: 0 microversion: 2.1 time: 0.637364 Sep 08 14:05:21.540364 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 355/706] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:20 2022] DELETE /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:05:21.548780 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0e5cd987-2707-41ad-aa5f-66999ae28902 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:21.549551 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0e5cd987-2707-41ad-aa5f-66999ae28902 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:21.556412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e5cd987-2707-41ad-aa5f-66999ae28902 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.556898 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e5cd987-2707-41ad-aa5f-66999ae28902 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.557332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e5cd987-2707-41ad-aa5f-66999ae28902 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:21.558034 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e5cd987-2707-41ad-aa5f-66999ae28902 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.558542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e5cd987-2707-41ad-aa5f-66999ae28902 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.559068 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0e5cd987-2707-41ad-aa5f-66999ae28902 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:21.698204 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0e5cd987-2707-41ad-aa5f-66999ae28902 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:21.706166 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0e5cd987-2707-41ad-aa5f-66999ae28902 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1555 microversion: 2.1 time: 0.161357 Sep 08 14:05:21.706967 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 352/707] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:21 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:21.801634 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e009032a-6178-4ce7-9dc4-3a4f4eb90781 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82cbd3f2-2927-4e51-a1f4-857616655a15"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:21.804111 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e009032a-6178-4ce7-9dc4-3a4f4eb90781 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:21.810444 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e009032a-6178-4ce7-9dc4-3a4f4eb90781 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.811038 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e009032a-6178-4ce7-9dc4-3a4f4eb90781 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.811480 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e009032a-6178-4ce7-9dc4-3a4f4eb90781 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:21.812209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e009032a-6178-4ce7-9dc4-3a4f4eb90781 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.812663 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e009032a-6178-4ce7-9dc4-3a4f4eb90781 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.813087 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e009032a-6178-4ce7-9dc4-3a4f4eb90781 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.117508 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-08bcb555-9421-494c-8eff-5e2aff525c19 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:22.118120 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-08bcb555-9421-494c-8eff-5e2aff525c19 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:22.124754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-08bcb555-9421-494c-8eff-5e2aff525c19 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:22.125241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-08bcb555-9421-494c-8eff-5e2aff525c19 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:22.126172 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-08bcb555-9421-494c-8eff-5e2aff525c19 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.126951 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-08bcb555-9421-494c-8eff-5e2aff525c19 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:22.127480 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-08bcb555-9421-494c-8eff-5e2aff525c19 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:22.127910 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-08bcb555-9421-494c-8eff-5e2aff525c19 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.264997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-08bcb555-9421-494c-8eff-5e2aff525c19 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:22.273312 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-08bcb555-9421-494c-8eff-5e2aff525c19 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1548 microversion: 2.1 time: 0.159647 Sep 08 14:05:22.274147 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 353/708] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:22 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:22.296664 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e04d9bc3-500d-4fb1-8255-1daf4f62c5ff tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:22.297151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e04d9bc3-500d-4fb1-8255-1daf4f62c5ff tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:22.303045 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e04d9bc3-500d-4fb1-8255-1daf4f62c5ff tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:22.303528 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e04d9bc3-500d-4fb1-8255-1daf4f62c5ff tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:22.303964 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e04d9bc3-500d-4fb1-8255-1daf4f62c5ff tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.304650 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e04d9bc3-500d-4fb1-8255-1daf4f62c5ff tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:22.305104 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e04d9bc3-500d-4fb1-8255-1daf4f62c5ff tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:22.305526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e04d9bc3-500d-4fb1-8255-1daf4f62c5ff tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.385323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e04d9bc3-500d-4fb1-8255-1daf4f62c5ff tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092496 Sep 08 14:05:22.385914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 354/709] 10.222.0.91 () {58 vars in 1275 bytes} [Thu Sep 8 14:05:22 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:22.454515 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1760160925", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f64a6c3-194c-4eee-8e56-9cce93d9920c"}], "security_groups": [{"name": "tempest-securitygroup--2001128376"}], "key_name": "tempest-keypair-281384556", "user_data": "}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:22.572899 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] validate_networks() for [('2f64a6c3-194c-4eee-8e56-9cce93d9920c', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:05:23.013129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:05:23.013552 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:05:23.014119 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:05:23.014435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:05:23.014878 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:05:23.024112 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:23.029809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:23.029809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:23.029809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:23.029809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:23.030202 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:23.043380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Getting quotas for project a9448ca7c8234f74b24c8f6710a0ef5c. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:05:23.047884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Getting quotas for user 48bf6dab289545bb80182c8904c05d6c and project a9448ca7c8234f74b24c8f6710a0ef5c. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:05:23.058483 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:23.061176 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:05:23.063560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:05:23.240475 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d0c92c9c-8125-463a-b18f-7c009ecf6a2e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.790235 Sep 08 14:05:23.241102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 355/710] 10.222.0.91 () {62 vars in 1188 bytes} [Thu Sep 8 14:05:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 14:05:23.245592 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-adc2b30e-252a-4db5-82f1-659d3cd4f1e0 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:23.246191 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-adc2b30e-252a-4db5-82f1-659d3cd4f1e0 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:23.253429 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-adc2b30e-252a-4db5-82f1-659d3cd4f1e0 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:23.253924 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-adc2b30e-252a-4db5-82f1-659d3cd4f1e0 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:23.254351 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-adc2b30e-252a-4db5-82f1-659d3cd4f1e0 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:23.255095 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-adc2b30e-252a-4db5-82f1-659d3cd4f1e0 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:23.255546 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-adc2b30e-252a-4db5-82f1-659d3cd4f1e0 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:23.255967 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-adc2b30e-252a-4db5-82f1-659d3cd4f1e0 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:23.415049 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-adc2b30e-252a-4db5-82f1-659d3cd4f1e0 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:23.429674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-adc2b30e-252a-4db5-82f1-659d3cd4f1e0 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1555 microversion: 2.1 time: 0.187519 Sep 08 14:05:23.430433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 356/711] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:23 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:23.435974 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0ef12126-30a0-4eca-bc31-b5fa2613287d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:23.436586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0ef12126-30a0-4eca-bc31-b5fa2613287d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:23.492384 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0ef12126-30a0-4eca-bc31-b5fa2613287d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:23.500399 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0ef12126-30a0-4eca-bc31-b5fa2613287d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:23.502250 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0ef12126-30a0-4eca-bc31-b5fa2613287d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:23.503500 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0ef12126-30a0-4eca-bc31-b5fa2613287d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1281 microversion: 2.20 time: 0.072056 Sep 08 14:05:23.504513 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 357/712] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:23 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:23.868416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-be8c7399-788c-458b-a6b0-fc87c4cf0564 req-7e3e63da-b42b-47bf-b935-62b19a484b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02257583-1cd3-4c60-9fd9-72bd2c16425e", "tag": "49ca98e0-9d14-4595-804a-6e918c13b9f0"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:23.887232 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-be8c7399-788c-458b-a6b0-fc87c4cf0564 req-7e3e63da-b42b-47bf-b935-62b19a484b8b service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:23.888759 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-be8c7399-788c-458b-a6b0-fc87c4cf0564 req-7e3e63da-b42b-47bf-b935-62b19a484b8b service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:23.889206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-be8c7399-788c-458b-a6b0-fc87c4cf0564 req-7e3e63da-b42b-47bf-b935-62b19a484b8b service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:23.899522 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:23.914779 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-be8c7399-788c-458b-a6b0-fc87c4cf0564 req-7e3e63da-b42b-47bf-b935-62b19a484b8b service nova] Creating event network-changed:49ca98e0-9d14-4595-804a-6e918c13b9f0 for instance 02257583-1cd3-4c60-9fd9-72bd2c16425e on hv-cinder-84773 Sep 08 14:05:23.921072 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-be8c7399-788c-458b-a6b0-fc87c4cf0564 req-7e3e63da-b42b-47bf-b935-62b19a484b8b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135783 Sep 08 14:05:23.921921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 358/713] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:24.456692 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-da9d17d9-9fa0-45e1-a9dc-a06b07b664e3 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:24.458012 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-da9d17d9-9fa0-45e1-a9dc-a06b07b664e3 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:24.476140 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-da9d17d9-9fa0-45e1-a9dc-a06b07b664e3 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.476674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-da9d17d9-9fa0-45e1-a9dc-a06b07b664e3 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.477115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-da9d17d9-9fa0-45e1-a9dc-a06b07b664e3 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.477849 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-da9d17d9-9fa0-45e1-a9dc-a06b07b664e3 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.478298 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-da9d17d9-9fa0-45e1-a9dc-a06b07b664e3 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.478718 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-da9d17d9-9fa0-45e1-a9dc-a06b07b664e3 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.572650 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-da9d17d9-9fa0-45e1-a9dc-a06b07b664e3 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:24.582152 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-da9d17d9-9fa0-45e1-a9dc-a06b07b664e3 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1513 microversion: 2.1 time: 0.132491 Sep 08 14:05:24.582804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 359/714] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:24 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1513 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:24.588101 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-954f1860-d759-4e82-8f52-0e333152b708 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:24.589244 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-954f1860-d759-4e82-8f52-0e333152b708 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:24.683984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-954f1860-d759-4e82-8f52-0e333152b708 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:24.692405 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-954f1860-d759-4e82-8f52-0e333152b708 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:24.694104 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-954f1860-d759-4e82-8f52-0e333152b708 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:24.695384 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-954f1860-d759-4e82-8f52-0e333152b708 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1281 microversion: 2.20 time: 0.111258 Sep 08 14:05:24.696024 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 360/715] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:24 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:24.783688 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-7d8f84fb-b489-4f15-8330-3b4300df68a4 req-10d8a7db-4857-4ff1-bf2a-0f82233b4cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe93656-bec8-4094-9b98-062302018a59", "name": "network-vif-deleted", "tag": "8d168477-404b-4ddb-8747-6423a9c84ab9"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:24.794731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-7d8f84fb-b489-4f15-8330-3b4300df68a4 req-10d8a7db-4857-4ff1-bf2a-0f82233b4cec service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.795172 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-7d8f84fb-b489-4f15-8330-3b4300df68a4 req-10d8a7db-4857-4ff1-bf2a-0f82233b4cec service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.795570 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-7d8f84fb-b489-4f15-8330-3b4300df68a4 req-10d8a7db-4857-4ff1-bf2a-0f82233b4cec service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.807004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-7d8f84fb-b489-4f15-8330-3b4300df68a4 req-10d8a7db-4857-4ff1-bf2a-0f82233b4cec service nova] Creating event network-vif-deleted:8d168477-404b-4ddb-8747-6423a9c84ab9 for instance 5fe93656-bec8-4094-9b98-062302018a59 on hv-cinder-84773 Sep 08 14:05:24.812100 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-7d8f84fb-b489-4f15-8330-3b4300df68a4 req-10d8a7db-4857-4ff1-bf2a-0f82233b4cec service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114470 Sep 08 14:05:24.812611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 361/716] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:24.876613 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e009032a-6178-4ce7-9dc4-3a4f4eb90781 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.079872 Sep 08 14:05:24.882728 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 356/717] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:05:21 2022] POST /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments => generated 194 bytes in 3082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:25.606585 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:25.607301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:25.614422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.615031 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.615459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.616139 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.616581 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.617035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.647810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.648279 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.648960 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.649393 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lazy-loading 'fault' on Instance uuid 5fe93656-bec8-4094-9b98-062302018a59 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:25.695392 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c2921e57dc44d2b6d334e88baae0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c533fdd2bf51465792fc266cefeb58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:25.703158 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8ebec91a-30b2-4d9f-b721-96edbabfe08c tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 200 len: 1348 microversion: 2.1 time: 0.101252 Sep 08 14:05:25.703720 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 362/718] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:25 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:25.722656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:25.723401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:25.730294 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.730771 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.731245 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.734662 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.734662 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.734662 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.799769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:25.808929 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:25.810377 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:25.815005 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-427b3d70-e5e6-44ea-a0ee-e57509ad1c7c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1277 microversion: 2.20 time: 0.093661 Sep 08 14:05:25.815005 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 357/719] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:25 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:26.726539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:26.727200 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] [instance: 5fe93656-bec8-4094-9b98-062302018a59] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:26.733601 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.733982 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.734403 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.735110 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.735549 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.735962 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.749028 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] HTTP exception thrown: Instance 5fe93656-bec8-4094-9b98-062302018a59 could not be found. Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Request method failure captured: Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 HTTP/1.1 Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfX4gxCG_KBvNbcoFwCWK8tgIbRf6tLqWjzmqYnyXsPcE2eJHw45Oxp7PIS98a_0_gHwFhYIz0fg6KYhvwABlGmScOSKJ4YMnY1IiU5EYH337nd985aW60qehRMT9TKTi5YKQkfgAzclG1rk4rnMa4OiiTEX9McEc-ttsJE66mPjGYE Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: c533fdd2bf51465792fc266cefeb58f7 Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-TestMinimumBasicScenario-390734584 Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:05:26.750647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c533fdd2bf51465792fc266cefeb58f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c533fdd2bf51465792fc266cefeb58f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c533fdd2bf51465792fc266cefeb58f7", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c533fdd2bf51465792fc266cefeb58f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-TestMinimumBasicScenario-390734584 Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: c533fdd2bf51465792fc266cefeb58f7 Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-TestMinimumBasicScenario-390734584 Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-TestMinimumBasicScenario-390734584-project Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 29c2921e57dc44d2b6d334e88baae0cd Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-TestMinimumBasicScenario-390734584-project Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 5fe93656-bec8-4094-9b98-062302018a59 could not be found. Sep 08 14:05:26.752209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '5fe93656-bec8-4094-9b98-062302018a59'} Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe93656-bec8-4094-9b98-062302018a59 could not be found. Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:26.754465 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe93656-bec8-4094-9b98-062302018a59 could not be found. Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe93656-bec8-4094-9b98-062302018a59 could not be found. Sep 08 14:05:26.755877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:26.757131 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Returning 404 to user: Instance 5fe93656-bec8-4094-9b98-062302018a59 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:26.757131 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-96cd346a-d40e-41e6-92fc-41f9eaab434a tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59" status: 404 len: 111 microversion: 2.1 time: 0.029563 Sep 08 14:05:26.757131 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 363/720] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:26 2022] GET /compute/v2.1/servers/5fe93656-bec8-4094-9b98-062302018a59 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:26.761427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-931fa5ee-ba4b-44ca-9459-d9913078a701 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] Calling method '.version_select at 0x7f51fbe6ad30>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:26.837249 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:26.837850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:26.843945 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.844426 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.844857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.845541 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.845987 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.846402 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.889451 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-931fa5ee-ba4b-44ca-9459-d9913078a701 tempest-TestMinimumBasicScenario-390734584 tempest-TestMinimumBasicScenario-390734584-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1806648975" status: 202 len: 0 microversion: 2.1 time: 0.131778 Sep 08 14:05:26.890076 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 358/721] 10.222.0.91 () {58 vars in 1272 bytes} [Thu Sep 8 14:05:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1806648975 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:27.074274 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:27.082401 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:27.083866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:27.084969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-93ac54fb-ee56-40c1-97ee-2ef53cc38119 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1333 microversion: 2.20 time: 0.251730 Sep 08 14:05:27.085517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 364/722] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:26 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1333 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:05:28.124103 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:28.125989 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:28.137140 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:28.138102 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:28.139145 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:28.139874 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:28.140325 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:28.140747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:28.147010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:28.294764 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:28.305231 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:28.307163 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:28.308441 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7d3c959d-b478-4eac-8005-b16bc341aabf tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1407 microversion: 2.20 time: 0.192070 Sep 08 14:05:28.309106 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 359/723] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:28 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:29.257697 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-c3462fb7-0b94-4e63-be0d-41e447cfc86d req-c7b80458-a823-4b90-88c0-d89bcfc1f9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94c00a6-d72c-4474-9ac0-8fedb2e32fe2", "tag": "d3992e28-2f02-43b3-9041-87bf6fafeffe"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:29.271009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-c3462fb7-0b94-4e63-be0d-41e447cfc86d req-c7b80458-a823-4b90-88c0-d89bcfc1f9ce service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:29.271821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-c3462fb7-0b94-4e63-be0d-41e447cfc86d req-c7b80458-a823-4b90-88c0-d89bcfc1f9ce service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:29.272316 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-c3462fb7-0b94-4e63-be0d-41e447cfc86d req-c7b80458-a823-4b90-88c0-d89bcfc1f9ce service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:29.286180 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-c3462fb7-0b94-4e63-be0d-41e447cfc86d req-c7b80458-a823-4b90-88c0-d89bcfc1f9ce service nova] Creating event network-changed:d3992e28-2f02-43b3-9041-87bf6fafeffe for instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 on hv-cinder-84773 Sep 08 14:05:29.292737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-c3462fb7-0b94-4e63-be0d-41e447cfc86d req-c7b80458-a823-4b90-88c0-d89bcfc1f9ce service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038830 Sep 08 14:05:29.294972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 365/724] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:29.335199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:29.336608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:29.340327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=4 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:29.346177 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:29.346771 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:29.347301 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:29.348718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:29.349355 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:29.349786 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:29.588357 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:29.597256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:29.599205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:29.600348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f8482725-2b15-426f-a51c-e5e0f5d7fa74 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1407 microversion: 2.20 time: 0.270667 Sep 08 14:05:29.600910 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 360/725] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:29 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:30.626208 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:30.627135 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:30.634563 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:30.635080 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:30.635557 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:30.636507 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:30.636892 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:30.637240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:30.784396 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:30.793345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:30.794787 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:30.795961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9ee2e7d1-48bf-47af-a355-3ce2f0e00ad3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1407 microversion: 2.20 time: 0.174347 Sep 08 14:05:30.807602 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 366/726] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:30 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:31.822248 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:31.823235 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:31.831358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.831992 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.834567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:31.834567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.834567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.834567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:32.062803 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:32.071475 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:32.072913 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:32.074081 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c294f7c0-da42-48da-a256-18c735eccfbc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1407 microversion: 2.20 time: 0.256071 Sep 08 14:05:32.074641 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 361/727] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:31 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:33.100079 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:33.101071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:33.107617 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:33.109414 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.110159 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.111222 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.114479 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.115237 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.116266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.296683 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:33.306255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:33.307718 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:33.308971 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-033297e7-7ab2-4bdb-81d9-8e4026ca7bc9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1407 microversion: 2.20 time: 0.212835 Sep 08 14:05:33.309517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 367/728] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:33 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:33.552150 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82cbd3f2-2927-4e51-a1f4-857616655a15"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:33.554741 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:33.561439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.566679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.566679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.566679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.566679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.567110 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.651155 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Invalid volume: volume 82cbd3f2-2927-4e51-a1f4-857616655a15 is already attached to instances: 789dd836-53d0-47a2-99a0-543e2997ad11 Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: POST /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments HTTP/1.1 Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 74 Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:05:33.652955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {"volumeAttachment": {"volumeId": "82cbd3f2-2927-4e51-a1f4-857616655a15"}} Sep 08 14:05:33.665599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Invalid volume: volume 82cbd3f2-2927-4e51-a1f4-857616655a15 is already attached to instances: 789dd836-53d0-47a2-99a0-543e2997ad11 Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'server_id': '789dd836-53d0-47a2-99a0-543e2997ad11', 'body': {'volumeAttachment': {'volumeId': '82cbd3f2-2927-4e51-a1f4-857616655a15'}}} Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 82cbd3f2-2927-4e51-a1f4-857616655a15 is already attached to instances: 789dd836-53d0-47a2-99a0-543e2997ad11 Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:05:33.667156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 82cbd3f2-2927-4e51-a1f4-857616655a15 is already attached to instances: 789dd836-53d0-47a2-99a0-543e2997ad11 Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:33.668515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:33.669906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:33.669906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:33.669906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:33.669906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 82cbd3f2-2927-4e51-a1f4-857616655a15 is already attached to instances: 789dd836-53d0-47a2-99a0-543e2997ad11 Sep 08 14:05:33.669906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:05:33.669906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 400 to user: Invalid volume: volume 82cbd3f2-2927-4e51-a1f4-857616655a15 is already attached to instances: 789dd836-53d0-47a2-99a0-543e2997ad11 {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:33.669906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d048306f-e242-4825-803e-dd334f352ce4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106405 Sep 08 14:05:33.669906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 362/729] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:05:33 2022] POST /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:05:33.727630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2267f04d-e2e1-4390-987b-8c8d89878385 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:33.728125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2267f04d-e2e1-4390-987b-8c8d89878385 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:33.735027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2267f04d-e2e1-4390-987b-8c8d89878385 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.738881 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2267f04d-e2e1-4390-987b-8c8d89878385 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.738881 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2267f04d-e2e1-4390-987b-8c8d89878385 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.738881 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2267f04d-e2e1-4390-987b-8c8d89878385 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.738881 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2267f04d-e2e1-4390-987b-8c8d89878385 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.739283 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2267f04d-e2e1-4390-987b-8c8d89878385 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.836229 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-2267f04d-e2e1-4390-987b-8c8d89878385 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lazy-loading 'services' on Instance uuid 789dd836-53d0-47a2-99a0-543e2997ad11 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:33.914256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-66fe8008-8882-4191-a659-ab994e716a3f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:33.914857 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-66fe8008-8882-4191-a659-ab994e716a3f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:33.921088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66fe8008-8882-4191-a659-ab994e716a3f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.921622 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66fe8008-8882-4191-a659-ab994e716a3f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.922058 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66fe8008-8882-4191-a659-ab994e716a3f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.922759 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66fe8008-8882-4191-a659-ab994e716a3f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.928756 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66fe8008-8882-4191-a659-ab994e716a3f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.928756 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66fe8008-8882-4191-a659-ab994e716a3f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.008612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-66fe8008-8882-4191-a659-ab994e716a3f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lazy-loading 'services' on Instance uuid 4a905c87-01a3-4760-8c5c-7df6b9b7b190 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:34.140413 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2267f04d-e2e1-4390-987b-8c8d89878385 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments/82cbd3f2-2927-4e51-a1f4-857616655a15" status: 202 len: 0 microversion: 2.1 time: 0.416476 Sep 08 14:05:34.141070 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 368/730] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:05:33 2022] DELETE /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments/82cbd3f2-2927-4e51-a1f4-857616655a15 => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:34.151356 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7f5765f8-ad1b-430e-a03c-2d0e48a15804 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:34.154109 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7f5765f8-ad1b-430e-a03c-2d0e48a15804 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:34.169081 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f5765f8-ad1b-430e-a03c-2d0e48a15804 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:34.169582 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f5765f8-ad1b-430e-a03c-2d0e48a15804 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:34.170015 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f5765f8-ad1b-430e-a03c-2d0e48a15804 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.170719 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f5765f8-ad1b-430e-a03c-2d0e48a15804 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:34.171208 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f5765f8-ad1b-430e-a03c-2d0e48a15804 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:34.171633 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f5765f8-ad1b-430e-a03c-2d0e48a15804 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.204816 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7f5765f8-ad1b-430e-a03c-2d0e48a15804 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058389 Sep 08 14:05:34.210181 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 369/731] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:34 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:34.294036 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-66fe8008-8882-4191-a659-ab994e716a3f tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "DELETE /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments/37b93427-dda3-4721-aee6-72d8c2e29925" status: 202 len: 0 microversion: 2.1 time: 0.384331 Sep 08 14:05:34.294720 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 363/732] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:05:33 2022] DELETE /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments/37b93427-dda3-4721-aee6-72d8c2e29925 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:05:34.303560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e81314b7-24b8-44d8-9a85-3094c773eae7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:34.305982 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e81314b7-24b8-44d8-9a85-3094c773eae7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:34.318868 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e81314b7-24b8-44d8-9a85-3094c773eae7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:34.319402 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e81314b7-24b8-44d8-9a85-3094c773eae7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:34.321047 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e81314b7-24b8-44d8-9a85-3094c773eae7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.321047 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e81314b7-24b8-44d8-9a85-3094c773eae7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:34.321444 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e81314b7-24b8-44d8-9a85-3094c773eae7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:34.321866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e81314b7-24b8-44d8-9a85-3094c773eae7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.337769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:34.339882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:34.349206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:34.356933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:34.357665 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.358587 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:34.359277 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:34.359899 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e81314b7-24b8-44d8-9a85-3094c773eae7 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060533 Sep 08 14:05:34.360103 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.360481 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 370/733] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:34 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:34.525477 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:34.534416 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:34.535925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:34.537337 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f46b9aec-e14a-4007-9395-de24a3bd49ad tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1407 microversion: 2.20 time: 0.204252 Sep 08 14:05:34.538461 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 364/734] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:34 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:05:34.638674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-6c741ddd-b8b4-47bd-9303-298e76cd97de req-1b5402f6-0d98-4f0f-b16a-b1e72ba69e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94c00a6-d72c-4474-9ac0-8fedb2e32fe2", "name": "network-vif-plugged", "status": "completed", "tag": "d3992e28-2f02-43b3-9041-87bf6fafeffe"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:34.649699 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-6c741ddd-b8b4-47bd-9303-298e76cd97de req-1b5402f6-0d98-4f0f-b16a-b1e72ba69e57 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:34.650181 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-6c741ddd-b8b4-47bd-9303-298e76cd97de req-1b5402f6-0d98-4f0f-b16a-b1e72ba69e57 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:34.652206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-6c741ddd-b8b4-47bd-9303-298e76cd97de req-1b5402f6-0d98-4f0f-b16a-b1e72ba69e57 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.661924 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-6c741ddd-b8b4-47bd-9303-298e76cd97de req-1b5402f6-0d98-4f0f-b16a-b1e72ba69e57 service nova] Creating event network-vif-plugged:d3992e28-2f02-43b3-9041-87bf6fafeffe for instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 on hv-cinder-84773 Sep 08 14:05:34.667091 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-6c741ddd-b8b4-47bd-9303-298e76cd97de req-1b5402f6-0d98-4f0f-b16a-b1e72ba69e57 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032674 Sep 08 14:05:34.667671 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 371/735] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:35.217846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-17e5e8ab-ee56-4b9b-a6e1-65cfc2bd4341 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:35.220190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-17e5e8ab-ee56-4b9b-a6e1-65cfc2bd4341 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:35.226917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-17e5e8ab-ee56-4b9b-a6e1-65cfc2bd4341 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.227419 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-17e5e8ab-ee56-4b9b-a6e1-65cfc2bd4341 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.227856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-17e5e8ab-ee56-4b9b-a6e1-65cfc2bd4341 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.228544 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-17e5e8ab-ee56-4b9b-a6e1-65cfc2bd4341 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.228991 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-17e5e8ab-ee56-4b9b-a6e1-65cfc2bd4341 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.229406 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-17e5e8ab-ee56-4b9b-a6e1-65cfc2bd4341 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.263893 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-17e5e8ab-ee56-4b9b-a6e1-65cfc2bd4341 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049979 Sep 08 14:05:35.264736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 365/736] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:35 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:35.378790 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=10 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:35.384703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-220db8c4-05b6-4236-8d32-196f8838746c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:35.386958 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-220db8c4-05b6-4236-8d32-196f8838746c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:35.395430 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-220db8c4-05b6-4236-8d32-196f8838746c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.396118 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-220db8c4-05b6-4236-8d32-196f8838746c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.396760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-220db8c4-05b6-4236-8d32-196f8838746c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.398137 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-220db8c4-05b6-4236-8d32-196f8838746c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.399043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-220db8c4-05b6-4236-8d32-196f8838746c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.399617 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-220db8c4-05b6-4236-8d32-196f8838746c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.433138 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-220db8c4-05b6-4236-8d32-196f8838746c tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058517 Sep 08 14:05:35.434017 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 372/737] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:35 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:35.563323 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:35.564096 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:35.572797 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.573423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.573924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.574692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.575359 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.575847 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.783697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:35.794183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:35.796619 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:35.797829 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6ce603a7-aa68-44ae-8bd2-ed034a1c56d3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1407 microversion: 2.20 time: 0.238576 Sep 08 14:05:35.798387 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 366/738] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:35 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:36.277775 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0ca1110a-c045-4e32-919a-23f324bd82d5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:36.279988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0ca1110a-c045-4e32-919a-23f324bd82d5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:36.288340 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ca1110a-c045-4e32-919a-23f324bd82d5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.291944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ca1110a-c045-4e32-919a-23f324bd82d5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.291944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ca1110a-c045-4e32-919a-23f324bd82d5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.291944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ca1110a-c045-4e32-919a-23f324bd82d5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.291944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ca1110a-c045-4e32-919a-23f324bd82d5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.292358 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0ca1110a-c045-4e32-919a-23f324bd82d5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.324398 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0ca1110a-c045-4e32-919a-23f324bd82d5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050779 Sep 08 14:05:36.327051 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 373/739] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:36 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:05:36.392262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-29e1eddf-0cb9-445b-a716-e500c7995390 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:36.395175 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-29e1eddf-0cb9-445b-a716-e500c7995390 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:36.400651 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-29e1eddf-0cb9-445b-a716-e500c7995390 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.401137 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-29e1eddf-0cb9-445b-a716-e500c7995390 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.401572 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-29e1eddf-0cb9-445b-a716-e500c7995390 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.402285 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-29e1eddf-0cb9-445b-a716-e500c7995390 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.402735 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-29e1eddf-0cb9-445b-a716-e500c7995390 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.403185 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-29e1eddf-0cb9-445b-a716-e500c7995390 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.429581 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-29e1eddf-0cb9-445b-a716-e500c7995390 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:36.455340 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ded8af1e-520e-495b-96d4-9bff0cc06d4a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:36.460772 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ded8af1e-520e-495b-96d4-9bff0cc06d4a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:36.469218 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded8af1e-520e-495b-96d4-9bff0cc06d4a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.469964 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded8af1e-520e-495b-96d4-9bff0cc06d4a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.470562 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded8af1e-520e-495b-96d4-9bff0cc06d4a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.471299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded8af1e-520e-495b-96d4-9bff0cc06d4a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.471749 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded8af1e-520e-495b-96d4-9bff0cc06d4a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.472168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded8af1e-520e-495b-96d4-9bff0cc06d4a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.505538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ded8af1e-520e-495b-96d4-9bff0cc06d4a tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056883 Sep 08 14:05:36.506431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 374/740] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:36 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:36.824022 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:36.825434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:36.833926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.834743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.835238 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.835945 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.836612 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.837193 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:37.011445 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-29e1eddf-0cb9-445b-a716-e500c7995390 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 204 len: 0 microversion: 2.1 time: 0.604534 Sep 08 14:05:37.012602 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:37.012716 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 367/741] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:36 2022] DELETE /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:05:37.012808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:37.012904 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-66144949-a7b4-468a-8a1d-eca3e9ff1487 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:37.013941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-66144949-a7b4-468a-8a1d-eca3e9ff1487 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:37.014860 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:37.016073 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ad44599f-73f3-4ff6-b439-f2427a61b414 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1407 microversion: 2.20 time: 0.196007 Sep 08 14:05:37.023315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66144949-a7b4-468a-8a1d-eca3e9ff1487 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:37.024434 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66144949-a7b4-468a-8a1d-eca3e9ff1487 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:37.025139 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66144949-a7b4-468a-8a1d-eca3e9ff1487 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:37.026063 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66144949-a7b4-468a-8a1d-eca3e9ff1487 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:37.026781 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66144949-a7b4-468a-8a1d-eca3e9ff1487 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:37.027618 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-66144949-a7b4-468a-8a1d-eca3e9ff1487 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:37.037114 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 375/742] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:36 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:37.256512 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-66144949-a7b4-468a-8a1d-eca3e9ff1487 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:37.273559 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-66144949-a7b4-468a-8a1d-eca3e9ff1487 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1682 microversion: 2.1 time: 0.263173 Sep 08 14:05:37.273559 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 368/743] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:37 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1682 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:37.518176 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-bbd50568-965b-4bc0-b6ef-987db02f9d3e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:37.520909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-bbd50568-965b-4bc0-b6ef-987db02f9d3e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:37.527922 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbd50568-965b-4bc0-b6ef-987db02f9d3e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:37.528223 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbd50568-965b-4bc0-b6ef-987db02f9d3e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:37.528655 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbd50568-965b-4bc0-b6ef-987db02f9d3e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:37.529351 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbd50568-965b-4bc0-b6ef-987db02f9d3e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:37.529798 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbd50568-965b-4bc0-b6ef-987db02f9d3e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:37.530961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-bbd50568-965b-4bc0-b6ef-987db02f9d3e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:37.574314 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-bbd50568-965b-4bc0-b6ef-987db02f9d3e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054143 Sep 08 14:05:37.574314 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 376/744] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:37 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:38.043712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:38.044251 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:38.054726 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.054726 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.054726 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.054726 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.055178 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.055178 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.188686 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:38.196945 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:38.198452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:38.199677 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1b0d5019-8c05-4a8f-a841-95f310eb6b03 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1598 microversion: 2.20 time: 0.160171 Sep 08 14:05:38.200240 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 369/745] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:05:38 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:05:38.225234 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7df5cf6b-ab19-4cf1-bfe5-2e1a5b108abc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:38.225725 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7df5cf6b-ab19-4cf1-bfe5-2e1a5b108abc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:38.232031 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df5cf6b-ab19-4cf1-bfe5-2e1a5b108abc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.232515 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df5cf6b-ab19-4cf1-bfe5-2e1a5b108abc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.232954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df5cf6b-ab19-4cf1-bfe5-2e1a5b108abc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.233644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df5cf6b-ab19-4cf1-bfe5-2e1a5b108abc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.234099 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df5cf6b-ab19-4cf1-bfe5-2e1a5b108abc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.234521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df5cf6b-ab19-4cf1-bfe5-2e1a5b108abc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.296140 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d9cf148a-53ba-41d3-a8b4-cb52f491f30e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:38.296751 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d9cf148a-53ba-41d3-a8b4-cb52f491f30e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:38.302792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9cf148a-53ba-41d3-a8b4-cb52f491f30e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.303309 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9cf148a-53ba-41d3-a8b4-cb52f491f30e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.303741 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9cf148a-53ba-41d3-a8b4-cb52f491f30e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.304442 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9cf148a-53ba-41d3-a8b4-cb52f491f30e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.304896 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9cf148a-53ba-41d3-a8b4-cb52f491f30e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.305316 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9cf148a-53ba-41d3-a8b4-cb52f491f30e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.313633 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7df5cf6b-ab19-4cf1-bfe5-2e1a5b108abc tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092969 Sep 08 14:05:38.314516 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 377/746] 10.222.0.91 () {60 vars in 1316 bytes} [Thu Sep 8 14:05:38 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:05:38.498698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d9cf148a-53ba-41d3-a8b4-cb52f491f30e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:38.507420 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d9cf148a-53ba-41d3-a8b4-cb52f491f30e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1682 microversion: 2.1 time: 0.214958 Sep 08 14:05:38.508463 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 370/747] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:38 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:38.582230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ca5ad101-e59a-4384-9fc4-36c980474111 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:38.585698 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ca5ad101-e59a-4384-9fc4-36c980474111 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:38.591666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca5ad101-e59a-4384-9fc4-36c980474111 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.592365 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca5ad101-e59a-4384-9fc4-36c980474111 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.592804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca5ad101-e59a-4384-9fc4-36c980474111 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.593506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca5ad101-e59a-4384-9fc4-36c980474111 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.593958 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca5ad101-e59a-4384-9fc4-36c980474111 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.594381 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca5ad101-e59a-4384-9fc4-36c980474111 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.611892 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:38.626062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ca5ad101-e59a-4384-9fc4-36c980474111 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048928 Sep 08 14:05:38.626636 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 378/748] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:38 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:05:38.715540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3098467d-6fb9-4470-bf26-81629d1d8545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:38.716129 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3098467d-6fb9-4470-bf26-81629d1d8545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:38.722117 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3098467d-6fb9-4470-bf26-81629d1d8545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.722598 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3098467d-6fb9-4470-bf26-81629d1d8545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.723059 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3098467d-6fb9-4470-bf26-81629d1d8545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.723745 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3098467d-6fb9-4470-bf26-81629d1d8545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.724188 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3098467d-6fb9-4470-bf26-81629d1d8545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.724608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3098467d-6fb9-4470-bf26-81629d1d8545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.750712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3098467d-6fb9-4470-bf26-81629d1d8545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:38.951043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:39.419012 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-261a3541-2eb1-4a9c-9829-e3a8b218d9c2 req-1ddb94b6-3dcc-4db0-a87a-91d9ee3759c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94c00a6-d72c-4474-9ac0-8fedb2e32fe2", "tag": "d3992e28-2f02-43b3-9041-87bf6fafeffe"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:39.428730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-261a3541-2eb1-4a9c-9829-e3a8b218d9c2 req-1ddb94b6-3dcc-4db0-a87a-91d9ee3759c6 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.429287 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-261a3541-2eb1-4a9c-9829-e3a8b218d9c2 req-1ddb94b6-3dcc-4db0-a87a-91d9ee3759c6 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.429785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-261a3541-2eb1-4a9c-9829-e3a8b218d9c2 req-1ddb94b6-3dcc-4db0-a87a-91d9ee3759c6 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.452460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3098467d-6fb9-4470-bf26-81629d1d8545 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "DELETE /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 204 len: 0 microversion: 2.1 time: 0.731018 Sep 08 14:05:39.454630 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 371/749] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:38 2022] DELETE /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:05:39.456552 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-261a3541-2eb1-4a9c-9829-e3a8b218d9c2 req-1ddb94b6-3dcc-4db0-a87a-91d9ee3759c6 service nova] Creating event network-changed:d3992e28-2f02-43b3-9041-87bf6fafeffe for instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 on hv-cinder-84773 Sep 08 14:05:39.465621 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-145c674f-c0d1-4632-a58f-bdda41930dc8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:39.466148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-261a3541-2eb1-4a9c-9829-e3a8b218d9c2 req-1ddb94b6-3dcc-4db0-a87a-91d9ee3759c6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050908 Sep 08 14:05:39.466698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-145c674f-c0d1-4632-a58f-bdda41930dc8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:39.467247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 379/750] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:39.478712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-145c674f-c0d1-4632-a58f-bdda41930dc8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.482624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-145c674f-c0d1-4632-a58f-bdda41930dc8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.482624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-145c674f-c0d1-4632-a58f-bdda41930dc8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.482624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-145c674f-c0d1-4632-a58f-bdda41930dc8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.482624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-145c674f-c0d1-4632-a58f-bdda41930dc8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.483256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-145c674f-c0d1-4632-a58f-bdda41930dc8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.534702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4e32de80-83ef-46f5-b330-0bb7a4f08708 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:39.535519 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4e32de80-83ef-46f5-b330-0bb7a4f08708 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:39.543022 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e32de80-83ef-46f5-b330-0bb7a4f08708 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.543605 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e32de80-83ef-46f5-b330-0bb7a4f08708 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.544273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e32de80-83ef-46f5-b330-0bb7a4f08708 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.545383 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e32de80-83ef-46f5-b330-0bb7a4f08708 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.545998 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e32de80-83ef-46f5-b330-0bb7a4f08708 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.546904 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e32de80-83ef-46f5-b330-0bb7a4f08708 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.641586 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-145c674f-c0d1-4632-a58f-bdda41930dc8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:39.655675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-145c674f-c0d1-4632-a58f-bdda41930dc8 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1689 microversion: 2.1 time: 0.195367 Sep 08 14:05:39.656270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 372/751] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:39 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1689 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:39.703262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4e32de80-83ef-46f5-b330-0bb7a4f08708 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:39.711949 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4e32de80-83ef-46f5-b330-0bb7a4f08708 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1682 microversion: 2.1 time: 0.181822 Sep 08 14:05:39.712533 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 380/752] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:39 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:40.679761 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-db7a9289-4fbf-48af-8c94-f31ba269ea7e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:40.680364 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-db7a9289-4fbf-48af-8c94-f31ba269ea7e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:40.687721 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-db7a9289-4fbf-48af-8c94-f31ba269ea7e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:40.688222 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-db7a9289-4fbf-48af-8c94-f31ba269ea7e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:40.688663 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-db7a9289-4fbf-48af-8c94-f31ba269ea7e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:40.689392 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-db7a9289-4fbf-48af-8c94-f31ba269ea7e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:40.689865 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-db7a9289-4fbf-48af-8c94-f31ba269ea7e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:40.690348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-db7a9289-4fbf-48af-8c94-f31ba269ea7e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:40.736211 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-385b892c-d63c-4d6d-8af8-9461908f30d4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:40.737015 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-385b892c-d63c-4d6d-8af8-9461908f30d4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:40.747574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-385b892c-d63c-4d6d-8af8-9461908f30d4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:40.749161 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-385b892c-d63c-4d6d-8af8-9461908f30d4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:40.749751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-385b892c-d63c-4d6d-8af8-9461908f30d4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:40.750564 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-385b892c-d63c-4d6d-8af8-9461908f30d4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:40.751439 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-385b892c-d63c-4d6d-8af8-9461908f30d4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:40.752304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-385b892c-d63c-4d6d-8af8-9461908f30d4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:40.861915 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-db7a9289-4fbf-48af-8c94-f31ba269ea7e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:40.871445 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-db7a9289-4fbf-48af-8c94-f31ba269ea7e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1689 microversion: 2.1 time: 0.195860 Sep 08 14:05:40.878929 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 373/753] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:40 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:40.908420 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-385b892c-d63c-4d6d-8af8-9461908f30d4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:40.917538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-385b892c-d63c-4d6d-8af8-9461908f30d4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1682 microversion: 2.1 time: 0.186008 Sep 08 14:05:40.919157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 381/754] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:40 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:41.894013 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-feb97cfc-7317-4d75-be47-24ab83b3ab10 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:41.894624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-feb97cfc-7317-4d75-be47-24ab83b3ab10 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:41.902460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feb97cfc-7317-4d75-be47-24ab83b3ab10 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:41.902925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feb97cfc-7317-4d75-be47-24ab83b3ab10 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:41.903422 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feb97cfc-7317-4d75-be47-24ab83b3ab10 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:41.904122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feb97cfc-7317-4d75-be47-24ab83b3ab10 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:41.904578 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feb97cfc-7317-4d75-be47-24ab83b3ab10 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:41.905002 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feb97cfc-7317-4d75-be47-24ab83b3ab10 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:41.943150 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-566f6ea7-6816-494d-80d4-42e9141b1b58 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:41.943773 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-566f6ea7-6816-494d-80d4-42e9141b1b58 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:41.950358 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-566f6ea7-6816-494d-80d4-42e9141b1b58 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:41.950849 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-566f6ea7-6816-494d-80d4-42e9141b1b58 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:41.951317 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-566f6ea7-6816-494d-80d4-42e9141b1b58 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:41.952023 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-566f6ea7-6816-494d-80d4-42e9141b1b58 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:41.952481 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-566f6ea7-6816-494d-80d4-42e9141b1b58 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:41.952907 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-566f6ea7-6816-494d-80d4-42e9141b1b58 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:42.037814 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-feb97cfc-7317-4d75-be47-24ab83b3ab10 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:42.045718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-feb97cfc-7317-4d75-be47-24ab83b3ab10 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1689 microversion: 2.1 time: 0.155718 Sep 08 14:05:42.052566 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 374/755] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:41 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:42.178271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-566f6ea7-6816-494d-80d4-42e9141b1b58 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:42.185946 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-566f6ea7-6816-494d-80d4-42e9141b1b58 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1682 microversion: 2.1 time: 0.247651 Sep 08 14:05:42.186513 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 382/756] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:41 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1682 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:42.312399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-3cbad8b2-8fe5-4837-8ce9-dcb2c0567f02 req-4d0fd376-aa6e-4803-bdf0-5e5cead61a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789dd836-53d0-47a2-99a0-543e2997ad11", "name": "network-vif-unplugged", "status": "completed", "tag": "bd2176c3-7d91-4643-8017-87305f438b36"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:42.324518 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-3cbad8b2-8fe5-4837-8ce9-dcb2c0567f02 req-4d0fd376-aa6e-4803-bdf0-5e5cead61a5c service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:42.325006 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-3cbad8b2-8fe5-4837-8ce9-dcb2c0567f02 req-4d0fd376-aa6e-4803-bdf0-5e5cead61a5c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:42.325437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-3cbad8b2-8fe5-4837-8ce9-dcb2c0567f02 req-4d0fd376-aa6e-4803-bdf0-5e5cead61a5c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:42.336809 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-3cbad8b2-8fe5-4837-8ce9-dcb2c0567f02 req-4d0fd376-aa6e-4803-bdf0-5e5cead61a5c service nova] Creating event network-vif-unplugged:bd2176c3-7d91-4643-8017-87305f438b36 for instance 789dd836-53d0-47a2-99a0-543e2997ad11 on hv-cinder-84773 Sep 08 14:05:42.341856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-3cbad8b2-8fe5-4837-8ce9-dcb2c0567f02 req-4d0fd376-aa6e-4803-bdf0-5e5cead61a5c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033283 Sep 08 14:05:42.342463 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 375/757] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:43.071716 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-81dc5708-6a8a-4f60-953a-9ef430df0c27 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:43.072989 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-81dc5708-6a8a-4f60-953a-9ef430df0c27 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:43.079839 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81dc5708-6a8a-4f60-953a-9ef430df0c27 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.080385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81dc5708-6a8a-4f60-953a-9ef430df0c27 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.080828 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81dc5708-6a8a-4f60-953a-9ef430df0c27 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.081561 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81dc5708-6a8a-4f60-953a-9ef430df0c27 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.082019 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81dc5708-6a8a-4f60-953a-9ef430df0c27 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.082450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-81dc5708-6a8a-4f60-953a-9ef430df0c27 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.211643 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2b466ee3-bde0-42a9-9515-c4bf3d330b1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:43.212620 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2b466ee3-bde0-42a9-9515-c4bf3d330b1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:43.220184 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b466ee3-bde0-42a9-9515-c4bf3d330b1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.220938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b466ee3-bde0-42a9-9515-c4bf3d330b1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.221447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b466ee3-bde0-42a9-9515-c4bf3d330b1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.222441 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b466ee3-bde0-42a9-9515-c4bf3d330b1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.223098 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b466ee3-bde0-42a9-9515-c4bf3d330b1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.223597 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b466ee3-bde0-42a9-9515-c4bf3d330b1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.470685 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2b466ee3-bde0-42a9-9515-c4bf3d330b1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:43.490475 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2b466ee3-bde0-42a9-9515-c4bf3d330b1a tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1682 microversion: 2.1 time: 0.283703 Sep 08 14:05:43.491227 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 376/758] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:43 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:43.617298 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-81dc5708-6a8a-4f60-953a-9ef430df0c27 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:43.626709 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-81dc5708-6a8a-4f60-953a-9ef430df0c27 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1689 microversion: 2.1 time: 0.559618 Sep 08 14:05:43.627583 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 383/759] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:43 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1689 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:44.513861 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-535f3558-b845-4665-82b1-87e662868f62 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:44.514616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-535f3558-b845-4665-82b1-87e662868f62 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:44.540357 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-f90e3391-e62e-4461-8d7f-67df03d2ca7d req-b1f37814-9795-4381-917c-8c550903bf8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a905c87-01a3-4760-8c5c-7df6b9b7b190", "name": "network-vif-deleted", "tag": "98ad18af-5b71-4073-a0f8-4fcd2a13191f"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:44.549525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-535f3558-b845-4665-82b1-87e662868f62 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.551294 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-535f3558-b845-4665-82b1-87e662868f62 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.556159 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-535f3558-b845-4665-82b1-87e662868f62 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.557602 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-535f3558-b845-4665-82b1-87e662868f62 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.562117 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-535f3558-b845-4665-82b1-87e662868f62 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.563472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-535f3558-b845-4665-82b1-87e662868f62 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.572932 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-f90e3391-e62e-4461-8d7f-67df03d2ca7d req-b1f37814-9795-4381-917c-8c550903bf8e service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.580179 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-f90e3391-e62e-4461-8d7f-67df03d2ca7d req-b1f37814-9795-4381-917c-8c550903bf8e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.581193 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-f90e3391-e62e-4461-8d7f-67df03d2ca7d req-b1f37814-9795-4381-917c-8c550903bf8e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.609946 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-f90e3391-e62e-4461-8d7f-67df03d2ca7d req-b1f37814-9795-4381-917c-8c550903bf8e service nova] Creating event network-vif-deleted:98ad18af-5b71-4073-a0f8-4fcd2a13191f for instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 on hv-cinder-84773 Sep 08 14:05:44.616007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-f90e3391-e62e-4461-8d7f-67df03d2ca7d req-b1f37814-9795-4381-917c-8c550903bf8e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079636 Sep 08 14:05:44.617141 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 384/760] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:44.661783 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-53eb5256-289d-4b84-b7ab-1d61b1526866 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:44.664644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-53eb5256-289d-4b84-b7ab-1d61b1526866 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:44.674809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53eb5256-289d-4b84-b7ab-1d61b1526866 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.675624 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53eb5256-289d-4b84-b7ab-1d61b1526866 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.676313 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53eb5256-289d-4b84-b7ab-1d61b1526866 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.677230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53eb5256-289d-4b84-b7ab-1d61b1526866 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.678011 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53eb5256-289d-4b84-b7ab-1d61b1526866 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.678742 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53eb5256-289d-4b84-b7ab-1d61b1526866 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.689636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-535f3558-b845-4665-82b1-87e662868f62 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:44.699934 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-535f3558-b845-4665-82b1-87e662868f62 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1614 microversion: 2.1 time: 0.190007 Sep 08 14:05:44.701388 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 377/761] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:44 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1614 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:44.799542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-53eb5256-289d-4b84-b7ab-1d61b1526866 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:44.809813 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-53eb5256-289d-4b84-b7ab-1d61b1526866 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1621 microversion: 2.1 time: 0.161865 Sep 08 14:05:44.813905 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 385/762] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:44 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1621 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:45.115109 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-2846bdae-1f90-4cbe-9d0b-9411392e7362 req-df74791c-5f5c-48e7-baea-a1ccd38ac3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789dd836-53d0-47a2-99a0-543e2997ad11", "name": "network-vif-deleted", "tag": "bd2176c3-7d91-4643-8017-87305f438b36"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:45.138486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2846bdae-1f90-4cbe-9d0b-9411392e7362 req-df74791c-5f5c-48e7-baea-a1ccd38ac3d7 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:45.138950 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2846bdae-1f90-4cbe-9d0b-9411392e7362 req-df74791c-5f5c-48e7-baea-a1ccd38ac3d7 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:45.139389 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2846bdae-1f90-4cbe-9d0b-9411392e7362 req-df74791c-5f5c-48e7-baea-a1ccd38ac3d7 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:45.165682 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-2846bdae-1f90-4cbe-9d0b-9411392e7362 req-df74791c-5f5c-48e7-baea-a1ccd38ac3d7 service nova] Creating event network-vif-deleted:bd2176c3-7d91-4643-8017-87305f438b36 for instance 789dd836-53d0-47a2-99a0-543e2997ad11 on hv-cinder-84773 Sep 08 14:05:45.172392 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-2846bdae-1f90-4cbe-9d0b-9411392e7362 req-df74791c-5f5c-48e7-baea-a1ccd38ac3d7 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061764 Sep 08 14:05:45.173325 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 378/763] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:45.731684 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:45.732400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:45.740785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:45.741335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:45.741785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:45.742771 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:45.743448 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:45.744496 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:45.808607 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:45.809100 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:45.809557 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:45.810010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lazy-loading 'fault' on Instance uuid 789dd836-53d0-47a2-99a0-543e2997ad11 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:45.839901 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:45.841296 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:45.855185 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:45.855680 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:45.860893 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:45.865505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:45.865505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:45.865505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:45.920537 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:45.934319 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6cb93441-b235-4e07-a62a-2a8c4a2b47d6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1332 microversion: 2.1 time: 0.212218 Sep 08 14:05:45.935322 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 386/764] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:45 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1332 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:45.944804 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:45.946293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:45.947447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:45.948607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lazy-loading 'fault' on Instance uuid 4a905c87-01a3-4760-8c5c-7df6b9b7b190 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:46.022711 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:46.038042 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2ce534db-1058-4c39-a9eb-feedc8805623 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 200 len: 1334 microversion: 2.1 time: 0.199201 Sep 08 14:05:46.040049 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 379/765] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:45 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 1334 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:46.969102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:46.972972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:46.991614 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:46.992503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:46.993235 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:46.995241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:46.996522 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:46.996522 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:47.049424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:47.051947 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:47.054020 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:47.054603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lazy-loading 'fault' on Instance uuid 789dd836-53d0-47a2-99a0-543e2997ad11 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:47.068779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:47.070070 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 4a905c87-01a3-4760-8c5c-7df6b9b7b190] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:47.089472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:47.092181 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:47.094317 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:47.098118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:47.099018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:47.100458 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:47.140207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] HTTP exception thrown: Instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 could not be found. Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Request method failure captured: Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 HTTP/1.1 Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVgsfQZT4q-AwtAeupucKbXfT6LGhmAzk0Dk9cZxUYc9pYOGHXV1Q14F05ICSXDdtU9v7LTi5J7ETbJGcmHJfaoROm1DUxoD2jYhOI4CMw5zblbDb9kPtA9N8mZ9DNzz-JlYodYsTwDVzUjTQ2Ub9wQwAnZ04e_ENmxl0_puCWPkQE Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 2078beb45799497ea367c552b6d8bcf9 Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:05:47.142031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_2078beb45799497ea367c552b6d8bcf9", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 2078beb45799497ea367c552b6d8bcf9 Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-ServerRescueNegativeTestJSON-993995764-project Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: e4916206c2ff42669276e0a93d6483ab Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-ServerRescueNegativeTestJSON-993995764-project Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 could not be found. Sep 08 14:05:47.144018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '4a905c87-01a3-4760-8c5c-7df6b9b7b190'} Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 could not be found. Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:47.144935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 could not be found. Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 could not be found. Sep 08 14:05:47.150424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:05:47.152070 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Returning 404 to user: Instance 4a905c87-01a3-4760-8c5c-7df6b9b7b190 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:47.152070 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-47d474d0-a9a8-4c39-a23f-fab6455e5497 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190" status: 404 len: 111 microversion: 2.1 time: 0.082030 Sep 08 14:05:47.152070 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 380/766] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:47 2022] GET /compute/v2.1/servers/4a905c87-01a3-4760-8c5c-7df6b9b7b190 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:05:47.161143 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-018f3de1-faa1-418a-8501-8ef821defc18 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '.version_select at 0x7f520007ce50>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:47.205510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:47.214394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-198c9ea3-e1ae-43c1-a470-278beb24fe90 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 200 len: 1332 microversion: 2.1 time: 0.258440 Sep 08 14:05:47.215130 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 387/767] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:46 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 1332 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:47.286006 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-018f3de1-faa1-418a-8501-8ef821defc18 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940230966" status: 202 len: 0 microversion: 2.1 time: 0.129791 Sep 08 14:05:47.286611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 381/768] 10.222.0.91 () {58 vars in 1218 bytes} [Thu Sep 8 14:05:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940230966 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:48.237782 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:48.238427 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:48.244980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:48.245489 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:48.246195 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:48.246919 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:48.250321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:48.250321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:48.263750 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 HTTP/1.1 Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:05:48.265434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:05:48.267217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '789dd836-53d0-47a2-99a0-543e2997ad11'} Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:48.268230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:05:48.269424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:48.275186 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:48.276060 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7ecbc6f1-b732-4551-8501-a7e96e78e8cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 404 len: 111 microversion: 2.1 time: 0.042268 Sep 08 14:05:48.276630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 388/769] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:48 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:48.286500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b4588dbc-6e82-4f74-9651-c6c8830c4867 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '.version_select at 0x7f51fbe50310>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:48.388927 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b4588dbc-6e82-4f74-9651-c6c8830c4867 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824373260" status: 202 len: 0 microversion: 2.1 time: 0.106853 Sep 08 14:05:48.389424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 382/770] 10.222.0.91 () {58 vars in 1221 bytes} [Thu Sep 8 14:05:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824373260 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:49.643518 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4010d8ee-f5f3-4666-9e0b-10b272e0c33f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: .version_select at 0x7f51fbdc99d0>, body: {"keypair": {"name": "tempest-keypair-1057944249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK24/Wpz7v25ZtFwhEPhC5c62RsYSrfBgGpMs8X9+I7xluIXNOgtD4nHkQiix2/GRPi8yS1p9ET3YK72tepTILuED86vZWlQpOKJ699Y07UxkKoB5V46Bw81IY4egHU0CA=="}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:49.664604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-4010d8ee-f5f3-4666-9e0b-10b272e0c33f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'key_pairs'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:05:49.669333 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-4010d8ee-f5f3-4666-9e0b-10b272e0c33f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for user beb41eb66e8140a6999b0bddab3c4afd and project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'key_pairs'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:05:49.792507 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4010d8ee-f5f3-4666-9e0b-10b272e0c33f tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152802 Sep 08 14:05:49.793683 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 389/771] 10.222.0.91 () {60 vars in 1159 bytes} [Thu Sep 8 14:05:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:51.566185 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-42303b81-4e04-4758-8724-0448d74e6f2d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:51.566734 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-42303b81-4e04-4758-8724-0448d74e6f2d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:51.568829 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:51.573735 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42303b81-4e04-4758-8724-0448d74e6f2d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:51.574221 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42303b81-4e04-4758-8724-0448d74e6f2d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:51.574662 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42303b81-4e04-4758-8724-0448d74e6f2d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:51.575632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42303b81-4e04-4758-8724-0448d74e6f2d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:51.576081 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42303b81-4e04-4758-8724-0448d74e6f2d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:51.576501 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42303b81-4e04-4758-8724-0448d74e6f2d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:51.603550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-42303b81-4e04-4758-8724-0448d74e6f2d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:51.999004 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-42303b81-4e04-4758-8724-0448d74e6f2d tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "DELETE /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 204 len: 0 microversion: 2.1 time: 0.437249 Sep 08 14:05:51.999722 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 383/772] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:51 2022] DELETE /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:05:52.013305 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f92cc752-5da4-4fc6-8e12-f31dfb13b1f1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:52.014000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f92cc752-5da4-4fc6-8e12-f31dfb13b1f1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:52.027554 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f92cc752-5da4-4fc6-8e12-f31dfb13b1f1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:52.028927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f92cc752-5da4-4fc6-8e12-f31dfb13b1f1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:52.029667 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f92cc752-5da4-4fc6-8e12-f31dfb13b1f1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:52.030647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f92cc752-5da4-4fc6-8e12-f31dfb13b1f1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:52.031458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f92cc752-5da4-4fc6-8e12-f31dfb13b1f1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:52.032224 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f92cc752-5da4-4fc6-8e12-f31dfb13b1f1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:52.346538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f92cc752-5da4-4fc6-8e12-f31dfb13b1f1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:52.354360 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f92cc752-5da4-4fc6-8e12-f31dfb13b1f1 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1507 microversion: 2.1 time: 0.348032 Sep 08 14:05:52.354961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 390/773] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:52 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:53.183599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1630634855", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38509184-249f-4b78-9ab0-339bc3caa638"}], "security_groups": [{"name": "tempest-securitygroup--1391962509"}], "key_name": "tempest-keypair-1057944249", "user_data": "}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:53.364049 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] validate_networks() for [('38509184-249f-4b78-9ab0-339bc3caa638', None, None, None, None, None)] {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:05:53.379237 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f87335bb-2bb3-43d4-8464-aeb4a888d4d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:53.380048 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f87335bb-2bb3-43d4-8464-aeb4a888d4d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:53.388677 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f87335bb-2bb3-43d4-8464-aeb4a888d4d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:53.390076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f87335bb-2bb3-43d4-8464-aeb4a888d4d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:53.391705 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f87335bb-2bb3-43d4-8464-aeb4a888d4d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:53.394848 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f87335bb-2bb3-43d4-8464-aeb4a888d4d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:53.395320 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f87335bb-2bb3-43d4-8464-aeb4a888d4d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:53.396825 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f87335bb-2bb3-43d4-8464-aeb4a888d4d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:53.621651 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f87335bb-2bb3-43d4-8464-aeb4a888d4d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:53.632000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f87335bb-2bb3-43d4-8464-aeb4a888d4d2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1507 microversion: 2.1 time: 0.257627 Sep 08 14:05:53.632898 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 391/774] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:53 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:54.574805 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:05:54.575724 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:05:54.576028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:05:54.576459 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:05:54.576957 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:05:54.588649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:54.589148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:54.589588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:54.590357 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:54.590825 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:54.591289 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:54.611778 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:05:54.616875 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Getting quotas for user beb41eb66e8140a6999b0bddab3c4afd and project 681592d8b63a438c8b4893eca9a3f04b. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:05:54.630810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:05:54.633816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:05:54.659053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-098f1f26-fe10-41eb-9915-a6d324b8a2b0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:54.659871 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-098f1f26-fe10-41eb-9915-a6d324b8a2b0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:54.670756 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-098f1f26-fe10-41eb-9915-a6d324b8a2b0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:54.671631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-098f1f26-fe10-41eb-9915-a6d324b8a2b0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:54.672137 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-098f1f26-fe10-41eb-9915-a6d324b8a2b0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:54.674090 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-098f1f26-fe10-41eb-9915-a6d324b8a2b0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:54.674514 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-098f1f26-fe10-41eb-9915-a6d324b8a2b0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:54.674962 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-098f1f26-fe10-41eb-9915-a6d324b8a2b0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:54.775271 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b65630b7-d802-452e-bf6c-e62ba488edba tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.598545 Sep 08 14:05:54.785697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 384/775] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:05:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:05:54.810389 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-57daca55-3000-4d57-9293-38de877da1cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:54.815298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-57daca55-3000-4d57-9293-38de877da1cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:54.949751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-098f1f26-fe10-41eb-9915-a6d324b8a2b0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:54.954056 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-57daca55-3000-4d57-9293-38de877da1cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:54.976664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-57daca55-3000-4d57-9293-38de877da1cb tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1242 microversion: 2.1 time: 0.187673 Sep 08 14:05:54.982077 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 385/776] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:54 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1242 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:54.982356 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-098f1f26-fe10-41eb-9915-a6d324b8a2b0 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1507 microversion: 2.1 time: 0.323220 Sep 08 14:05:55.002208 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 392/777] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:54 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:55.295911 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-f55837b7-160f-40f5-abbf-c76731b98418 req-794f0e00-d53e-49b3-9fdc-bd4c12ddb26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669cbb96-aa6a-43b6-b943-3d6ffef440c7", "name": "network-vif-deleted", "tag": "826f910d-daa7-494d-a27b-a16e5794deab"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:55.321398 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f55837b7-160f-40f5-abbf-c76731b98418 req-794f0e00-d53e-49b3-9fdc-bd4c12ddb26c service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:55.322258 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f55837b7-160f-40f5-abbf-c76731b98418 req-794f0e00-d53e-49b3-9fdc-bd4c12ddb26c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:55.323045 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f55837b7-160f-40f5-abbf-c76731b98418 req-794f0e00-d53e-49b3-9fdc-bd4c12ddb26c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:55.340856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-f55837b7-160f-40f5-abbf-c76731b98418 req-794f0e00-d53e-49b3-9fdc-bd4c12ddb26c service nova] Creating event network-vif-deleted:826f910d-daa7-494d-a27b-a16e5794deab for instance 669cbb96-aa6a-43b6-b943-3d6ffef440c7 on hv-cinder-84773 Sep 08 14:05:55.347026 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-f55837b7-160f-40f5-abbf-c76731b98418 req-794f0e00-d53e-49b3-9fdc-bd4c12ddb26c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055919 Sep 08 14:05:55.352609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 386/778] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:56.008894 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:56.009549 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:56.015480 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e62b2b57-4ccf-4b9e-820a-b9ac98d43f20 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:56.016257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e62b2b57-4ccf-4b9e-820a-b9ac98d43f20 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:56.023875 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:56.032300 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62b2b57-4ccf-4b9e-820a-b9ac98d43f20 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.033104 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62b2b57-4ccf-4b9e-820a-b9ac98d43f20 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.033544 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62b2b57-4ccf-4b9e-820a-b9ac98d43f20 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.034755 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62b2b57-4ccf-4b9e-820a-b9ac98d43f20 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.036298 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.036999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62b2b57-4ccf-4b9e-820a-b9ac98d43f20 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.037655 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.038353 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e62b2b57-4ccf-4b9e-820a-b9ac98d43f20 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.039000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.043964 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.049789 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.049789 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.112776 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.113279 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.114228 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.118734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lazy-loading 'fault' on Instance uuid 669cbb96-aa6a-43b6-b943-3d6ffef440c7 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:56.161742 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e62b2b57-4ccf-4b9e-820a-b9ac98d43f20 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:56.171461 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e62b2b57-4ccf-4b9e-820a-b9ac98d43f20 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1246 microversion: 2.1 time: 0.160342 Sep 08 14:05:56.172259 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 387/779] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:56 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1246 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:56.195551 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:56.203551 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4e0d5f6e-84d9-4356-a2aa-6b2b9d3f3c80 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 200 len: 1312 microversion: 2.1 time: 0.199092 Sep 08 14:05:56.204144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 393/780] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:56 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:57.199770 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6af6a496-2534-4c73-895e-92f47ca4bd64 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:57.200391 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6af6a496-2534-4c73-895e-92f47ca4bd64 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:57.213389 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6af6a496-2534-4c73-895e-92f47ca4bd64 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.214361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6af6a496-2534-4c73-895e-92f47ca4bd64 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.215412 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6af6a496-2534-4c73-895e-92f47ca4bd64 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.216926 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6af6a496-2534-4c73-895e-92f47ca4bd64 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.217770 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6af6a496-2534-4c73-895e-92f47ca4bd64 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.218818 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6af6a496-2534-4c73-895e-92f47ca4bd64 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.229176 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:57.229929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: 669cbb96-aa6a-43b6-b943-3d6ffef440c7] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:57.237498 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.237976 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.238653 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.240171 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.240782 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.241423 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.258862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] HTTP exception thrown: Instance 669cbb96-aa6a-43b6-b943-3d6ffef440c7 could not be found. Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Request method failure captured: Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 HTTP/1.1 Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVgsfQZT4q-AwtAeupucKbXfT6LGhmAzk0Dk9cZxUYc9pYOGHXV1Q14F05ICSXDdtU9v7LTi5J7ETbJGcmHJfaoROm1DUxoD2jYhOI4CMw5zblbDb9kPtA9N8mZ9DNzz-JlYodYsTwDVzUjTQ2Ub9wQwAnZ04e_ENmxl0_puCWPkQE Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 2078beb45799497ea367c552b6d8bcf9 Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:05:57.260542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_2078beb45799497ea367c552b6d8bcf9", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 2078beb45799497ea367c552b6d8bcf9 Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-ServerRescueNegativeTestJSON-993995764-project Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: e4916206c2ff42669276e0a93d6483ab Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-993995764-project Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 669cbb96-aa6a-43b6-b943-3d6ffef440c7 could not be found. Sep 08 14:05:57.261995 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '669cbb96-aa6a-43b6-b943-3d6ffef440c7'} Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 669cbb96-aa6a-43b6-b943-3d6ffef440c7 could not be found. Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:57.262765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 669cbb96-aa6a-43b6-b943-3d6ffef440c7 could not be found. Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 669cbb96-aa6a-43b6-b943-3d6ffef440c7 could not be found. Sep 08 14:05:57.263937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:05:57.264950 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Returning 404 to user: Instance 669cbb96-aa6a-43b6-b943-3d6ffef440c7 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:57.265672 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-15cac74a-b8f3-42b7-8a8c-dabd27375424 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7" status: 404 len: 111 microversion: 2.1 time: 0.040568 Sep 08 14:05:57.270325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 394/781] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:57 2022] GET /compute/v2.1/servers/669cbb96-aa6a-43b6-b943-3d6ffef440c7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:05:57.277067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7f055116-0bda-49d6-8150-8babda432528 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:57.277907 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7f055116-0bda-49d6-8150-8babda432528 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:57.284694 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f055116-0bda-49d6-8150-8babda432528 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.285678 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f055116-0bda-49d6-8150-8babda432528 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.287268 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f055116-0bda-49d6-8150-8babda432528 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.288662 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f055116-0bda-49d6-8150-8babda432528 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.289160 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f055116-0bda-49d6-8150-8babda432528 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.289622 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7f055116-0bda-49d6-8150-8babda432528 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.327181 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7f055116-0bda-49d6-8150-8babda432528 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Going to try to terminate instance {{(pid=133059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:57.327858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6af6a496-2534-4c73-895e-92f47ca4bd64 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:57.339964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6af6a496-2534-4c73-895e-92f47ca4bd64 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1294 microversion: 2.1 time: 0.143999 Sep 08 14:05:57.368318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 388/782] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:57 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1294 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:57.725843 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7f055116-0bda-49d6-8150-8babda432528 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 204 len: 0 microversion: 2.1 time: 0.453665 Sep 08 14:05:57.729488 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 395/783] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:57 2022] DELETE /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:05:57.736870 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9411b61d-e6d6-438d-89d6-961f0edc90f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:57.737460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9411b61d-e6d6-438d-89d6-961f0edc90f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:57.745300 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9411b61d-e6d6-438d-89d6-961f0edc90f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.746094 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9411b61d-e6d6-438d-89d6-961f0edc90f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.746747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9411b61d-e6d6-438d-89d6-961f0edc90f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.747641 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9411b61d-e6d6-438d-89d6-961f0edc90f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.748254 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9411b61d-e6d6-438d-89d6-961f0edc90f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.748978 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9411b61d-e6d6-438d-89d6-961f0edc90f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.949212 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9411b61d-e6d6-438d-89d6-961f0edc90f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:57.968714 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9411b61d-e6d6-438d-89d6-961f0edc90f2 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.234962 Sep 08 14:05:57.971438 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 389/784] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:57 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:58.379184 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6e0b10ad-9437-4047-aa86-c7ecdf06851d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:58.380829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6e0b10ad-9437-4047-aa86-c7ecdf06851d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:58.389579 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6e0b10ad-9437-4047-aa86-c7ecdf06851d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:58.390114 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6e0b10ad-9437-4047-aa86-c7ecdf06851d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:58.390836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6e0b10ad-9437-4047-aa86-c7ecdf06851d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:58.391673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6e0b10ad-9437-4047-aa86-c7ecdf06851d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:58.392077 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6e0b10ad-9437-4047-aa86-c7ecdf06851d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:58.392534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6e0b10ad-9437-4047-aa86-c7ecdf06851d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:58.397976 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:58.464451 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-6e0b10ad-9437-4047-aa86-c7ecdf06851d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:58.472761 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6e0b10ad-9437-4047-aa86-c7ecdf06851d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1302 microversion: 2.1 time: 0.100227 Sep 08 14:05:58.473345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 396/785] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:58 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:58.996034 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-822fe84f-6156-4af5-b524-29c9b46ce818 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:58.997559 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-822fe84f-6156-4af5-b524-29c9b46ce818 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:59.004876 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-822fe84f-6156-4af5-b524-29c9b46ce818 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:59.005405 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-822fe84f-6156-4af5-b524-29c9b46ce818 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:59.005841 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-822fe84f-6156-4af5-b524-29c9b46ce818 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:59.010093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-822fe84f-6156-4af5-b524-29c9b46ce818 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:59.010577 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-822fe84f-6156-4af5-b524-29c9b46ce818 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:59.013309 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-822fe84f-6156-4af5-b524-29c9b46ce818 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:59.183370 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-822fe84f-6156-4af5-b524-29c9b46ce818 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:59.192644 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-822fe84f-6156-4af5-b524-29c9b46ce818 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.200522 Sep 08 14:05:59.193439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 390/786] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:58 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:59.297845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-35a80666-3a81-4763-ae59-981dadaeb392 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Action: 'create', calling method: .version_select at 0x7f51fbd78280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1027931487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7HGa/lQLyfwjBCXdtb2DNk2/44of5fkFw3ymg24yjHTQl7+fXjXaqjH5p5yMTy+xbtAeHWbwLtwmfcQmb2oEsLI2y3mU/eSUaN+JvxErPElPGaB1/x1X7zaNSNATWrZA=="}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:59.315418 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-35a80666-3a81-4763-ae59-981dadaeb392 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Getting quotas for project 0d4361bb4c424b41aed6f6afa040df84. Resources: {'key_pairs'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:05:59.320413 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-35a80666-3a81-4763-ae59-981dadaeb392 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Getting quotas for user 30cfda5bb8284716935e7670bf44f647 and project 0d4361bb4c424b41aed6f6afa040df84. Resources: {'key_pairs'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:05:59.472667 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-35a80666-3a81-4763-ae59-981dadaeb392 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.383285 Sep 08 14:05:59.473320 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 397/787] 10.222.0.91 () {60 vars in 1159 bytes} [Thu Sep 8 14:05:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:59.507468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-423d6c5a-8850-49c2-ace2-a1834f1651c7 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:59.508065 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-423d6c5a-8850-49c2-ace2-a1834f1651c7 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:59.514997 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-423d6c5a-8850-49c2-ace2-a1834f1651c7 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:59.515459 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-423d6c5a-8850-49c2-ace2-a1834f1651c7 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:59.516027 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-423d6c5a-8850-49c2-ace2-a1834f1651c7 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:59.516730 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-423d6c5a-8850-49c2-ace2-a1834f1651c7 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:59.517176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-423d6c5a-8850-49c2-ace2-a1834f1651c7 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:59.517605 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-423d6c5a-8850-49c2-ace2-a1834f1651c7 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:59.596044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-423d6c5a-8850-49c2-ace2-a1834f1651c7 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:59.604716 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-423d6c5a-8850-49c2-ace2-a1834f1651c7 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1302 microversion: 2.1 time: 0.102869 Sep 08 14:05:59.614180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 391/788] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:59 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:00.227708 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-570c3335-aa90-48df-b27d-009bf150a113 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:00.228435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-570c3335-aa90-48df-b27d-009bf150a113 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:00.236606 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-570c3335-aa90-48df-b27d-009bf150a113 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.237109 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-570c3335-aa90-48df-b27d-009bf150a113 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.237548 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-570c3335-aa90-48df-b27d-009bf150a113 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.238269 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-570c3335-aa90-48df-b27d-009bf150a113 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.238727 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-570c3335-aa90-48df-b27d-009bf150a113 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.239184 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-570c3335-aa90-48df-b27d-009bf150a113 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.377203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9613631e-464b-42a9-9590-212b93d9bc1e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:00.379166 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9613631e-464b-42a9-9590-212b93d9bc1e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:00.393260 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9613631e-464b-42a9-9590-212b93d9bc1e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.393896 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9613631e-464b-42a9-9590-212b93d9bc1e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.394467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9613631e-464b-42a9-9590-212b93d9bc1e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.395423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9613631e-464b-42a9-9590-212b93d9bc1e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.396622 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9613631e-464b-42a9-9590-212b93d9bc1e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.397215 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9613631e-464b-42a9-9590-212b93d9bc1e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.421963 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-570c3335-aa90-48df-b27d-009bf150a113 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:00.430157 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-570c3335-aa90-48df-b27d-009bf150a113 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1521 microversion: 2.1 time: 0.208039 Sep 08 14:06:00.431003 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 398/789] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:00 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:00.445779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9613631e-464b-42a9-9590-212b93d9bc1e tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/ips" status: 200 len: 146 microversion: 2.1 time: 0.058867 Sep 08 14:06:00.445779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 392/790] 10.222.0.91 () {58 vars in 1248 bytes} [Thu Sep 8 14:06:00 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/ips => generated 146 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:06:00.633175 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-54e3c395-0a77-4dbf-84d0-c463cf35f7f3 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:00.633984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-54e3c395-0a77-4dbf-84d0-c463cf35f7f3 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:00.644952 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e3c395-0a77-4dbf-84d0-c463cf35f7f3 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.646294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e3c395-0a77-4dbf-84d0-c463cf35f7f3 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.646678 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e3c395-0a77-4dbf-84d0-c463cf35f7f3 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.650307 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e3c395-0a77-4dbf-84d0-c463cf35f7f3 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.651399 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e3c395-0a77-4dbf-84d0-c463cf35f7f3 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.652000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e3c395-0a77-4dbf-84d0-c463cf35f7f3 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.736055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-54e3c395-0a77-4dbf-84d0-c463cf35f7f3 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:00.739167 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-54e3c395-0a77-4dbf-84d0-c463cf35f7f3 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1302 microversion: 2.1 time: 0.113663 Sep 08 14:06:00.740350 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 399/791] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:00 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1302 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:01.277796 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-6f3c0ba8-73f9-4af0-8f8e-a46d34c77fde req-fb9b0c70-7fc7-421e-b66c-a6f438e71499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e409e9dd-aae7-4cce-9c1f-2c449abf9093", "name": "network-vif-deleted", "tag": "58bdc1ca-5bc3-4026-a9e9-b7ad9f7ea1da"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:01.311691 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-6f3c0ba8-73f9-4af0-8f8e-a46d34c77fde req-fb9b0c70-7fc7-421e-b66c-a6f438e71499 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.313554 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-6f3c0ba8-73f9-4af0-8f8e-a46d34c77fde req-fb9b0c70-7fc7-421e-b66c-a6f438e71499 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.314197 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-6f3c0ba8-73f9-4af0-8f8e-a46d34c77fde req-fb9b0c70-7fc7-421e-b66c-a6f438e71499 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.321252 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:01.332344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-6f3c0ba8-73f9-4af0-8f8e-a46d34c77fde req-fb9b0c70-7fc7-421e-b66c-a6f438e71499 service nova] Creating event network-vif-deleted:58bdc1ca-5bc3-4026-a9e9-b7ad9f7ea1da for instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 on hv-cinder-84773 Sep 08 14:06:01.341344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-6f3c0ba8-73f9-4af0-8f8e-a46d34c77fde req-fb9b0c70-7fc7-421e-b66c-a6f438e71499 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067266 Sep 08 14:06:01.342684 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 393/792] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:01.454509 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6102b29f-b893-4452-b8e4-8398b9f362b9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:01.455152 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6102b29f-b893-4452-b8e4-8398b9f362b9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:01.464313 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6102b29f-b893-4452-b8e4-8398b9f362b9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.464815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6102b29f-b893-4452-b8e4-8398b9f362b9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.465248 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6102b29f-b893-4452-b8e4-8398b9f362b9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.466021 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6102b29f-b893-4452-b8e4-8398b9f362b9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.466478 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6102b29f-b893-4452-b8e4-8398b9f362b9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.466932 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6102b29f-b893-4452-b8e4-8398b9f362b9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.571887 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-6102b29f-b893-4452-b8e4-8398b9f362b9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:01.598218 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6102b29f-b893-4452-b8e4-8398b9f362b9 tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1479 microversion: 2.1 time: 0.136305 Sep 08 14:06:01.600992 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 400/793] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:01 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1479 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:01.764001 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d2efbee1-2731-4068-bacc-702997597a05 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:01.764912 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d2efbee1-2731-4068-bacc-702997597a05 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:01.776816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2efbee1-2731-4068-bacc-702997597a05 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.777316 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2efbee1-2731-4068-bacc-702997597a05 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.787739 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2efbee1-2731-4068-bacc-702997597a05 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.793270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2efbee1-2731-4068-bacc-702997597a05 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.794608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2efbee1-2731-4068-bacc-702997597a05 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.795256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d2efbee1-2731-4068-bacc-702997597a05 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.029706 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d2efbee1-2731-4068-bacc-702997597a05 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:02.035321 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d2efbee1-2731-4068-bacc-702997597a05 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1368 microversion: 2.1 time: 0.276470 Sep 08 14:06:02.037222 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 394/794] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:01 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:02.460468 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-51557d40-d7d3-40b5-b83d-29340d6feb40 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "868dbf4f-21e7-4047-8946-b0b7b24c1a07"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:02.464109 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-51557d40-d7d3-40b5-b83d-29340d6feb40 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:02.471853 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51557d40-d7d3-40b5-b83d-29340d6feb40 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.472658 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51557d40-d7d3-40b5-b83d-29340d6feb40 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.473282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51557d40-d7d3-40b5-b83d-29340d6feb40 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.474602 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51557d40-d7d3-40b5-b83d-29340d6feb40 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.475401 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51557d40-d7d3-40b5-b83d-29340d6feb40 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.476059 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-51557d40-d7d3-40b5-b83d-29340d6feb40 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.623712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:02.624467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:02.634390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.635021 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.635683 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.636687 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.637386 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.638078 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.689433 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.689951 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.690401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.690866 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lazy-loading 'fault' on Instance uuid e409e9dd-aae7-4cce-9c1f-2c449abf9093 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:06:02.738631 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4916206c2ff42669276e0a93d6483ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2078beb45799497ea367c552b6d8bcf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:02.748975 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-781e4d33-2166-4784-a323-1a45e354c00e tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 200 len: 1312 microversion: 2.1 time: 0.129620 Sep 08 14:06:02.756291 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 395/795] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:02 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 1312 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:02.954501 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-8772555b-fa14-49c7-8d77-1fda44721fc2 req-d18f8989-749d-4d16-a8a3-eb6cd6f9d9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e8a357-9c5c-41db-8440-b5ebe04b6c8c", "tag": "a93a84a1-d56f-4e9f-a443-a8184787c4a9"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:02.969568 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-8772555b-fa14-49c7-8d77-1fda44721fc2 req-d18f8989-749d-4d16-a8a3-eb6cd6f9d9d3 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.971845 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-8772555b-fa14-49c7-8d77-1fda44721fc2 req-d18f8989-749d-4d16-a8a3-eb6cd6f9d9d3 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.972429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-8772555b-fa14-49c7-8d77-1fda44721fc2 req-d18f8989-749d-4d16-a8a3-eb6cd6f9d9d3 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.989599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-8772555b-fa14-49c7-8d77-1fda44721fc2 req-d18f8989-749d-4d16-a8a3-eb6cd6f9d9d3 service nova] Creating event network-changed:a93a84a1-d56f-4e9f-a443-a8184787c4a9 for instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c on hv-cinder-84773 Sep 08 14:06:03.016638 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-8772555b-fa14-49c7-8d77-1fda44721fc2 req-d18f8989-749d-4d16-a8a3-eb6cd6f9d9d3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065742 Sep 08 14:06:03.021293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 396/796] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:03.060236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-98a6dbee-d845-4750-86cd-6b7e4f4619dd tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:03.060946 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-98a6dbee-d845-4750-86cd-6b7e4f4619dd tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:03.073753 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98a6dbee-d845-4750-86cd-6b7e4f4619dd tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:03.079354 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98a6dbee-d845-4750-86cd-6b7e4f4619dd tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:03.080066 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98a6dbee-d845-4750-86cd-6b7e4f4619dd tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.080822 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98a6dbee-d845-4750-86cd-6b7e4f4619dd tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:03.081632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98a6dbee-d845-4750-86cd-6b7e4f4619dd tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:03.082528 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98a6dbee-d845-4750-86cd-6b7e4f4619dd tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.246179 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-98a6dbee-d845-4750-86cd-6b7e4f4619dd tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:03.255790 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-98a6dbee-d845-4750-86cd-6b7e4f4619dd tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1368 microversion: 2.1 time: 0.199351 Sep 08 14:06:03.266195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 397/797] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:03 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:03.775649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:03.776262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] [instance: e409e9dd-aae7-4cce-9c1f-2c449abf9093] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:03.783295 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:03.783832 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:03.792694 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.793486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:03.793963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:03.794393 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.803331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-51557d40-d7d3-40b5-b83d-29340d6feb40 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.347877 Sep 08 14:06:03.810849 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 401/798] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:06:02 2022] POST /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments => generated 194 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:03.839723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] HTTP exception thrown: Instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 could not be found. Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Request method failure captured: Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 HTTP/1.1 Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVgsfQZT4q-AwtAeupucKbXfT6LGhmAzk0Dk9cZxUYc9pYOGHXV1Q14F05ICSXDdtU9v7LTi5J7ETbJGcmHJfaoROm1DUxoD2jYhOI4CMw5zblbDb9kPtA9N8mZ9DNzz-JlYodYsTwDVzUjTQ2Ub9wQwAnZ04e_ENmxl0_puCWPkQE Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 2078beb45799497ea367c552b6d8bcf9 Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:06:03.841399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_2078beb45799497ea367c552b6d8bcf9", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/2078beb45799497ea367c552b6d8bcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 2078beb45799497ea367c552b6d8bcf9 Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-993995764 Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-ServerRescueNegativeTestJSON-993995764-project Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: e4916206c2ff42669276e0a93d6483ab Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-ServerRescueNegativeTestJSON-993995764-project Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 could not be found. Sep 08 14:06:03.842743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'e409e9dd-aae7-4cce-9c1f-2c449abf9093'} Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 could not be found. Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:06:03.843567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 could not be found. Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 could not be found. Sep 08 14:06:03.845018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:03.846247 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] Returning 404 to user: Instance e409e9dd-aae7-4cce-9c1f-2c449abf9093 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:06:03.846247 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a39b3e6d-fccc-4724-af1a-adc080c4ac3b tempest-ServerRescueNegativeTestJSON-993995764 tempest-ServerRescueNegativeTestJSON-993995764-project] 10.222.0.91 "GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093" status: 404 len: 111 microversion: 2.1 time: 0.073025 Sep 08 14:06:03.846934 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 398/799] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:03 2022] GET /compute/v2.1/servers/e409e9dd-aae7-4cce-9c1f-2c449abf9093 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:06:04.282131 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3adde78d-7bce-4c45-a715-aacdb7a8b3f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:04.283156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3adde78d-7bce-4c45-a715-aacdb7a8b3f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:04.290651 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3adde78d-7bce-4c45-a715-aacdb7a8b3f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.294694 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3adde78d-7bce-4c45-a715-aacdb7a8b3f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.294694 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3adde78d-7bce-4c45-a715-aacdb7a8b3f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.294694 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3adde78d-7bce-4c45-a715-aacdb7a8b3f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.294694 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3adde78d-7bce-4c45-a715-aacdb7a8b3f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.295109 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3adde78d-7bce-4c45-a715-aacdb7a8b3f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.453702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3adde78d-7bce-4c45-a715-aacdb7a8b3f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:04.461832 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3adde78d-7bce-4c45-a715-aacdb7a8b3f6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1368 microversion: 2.1 time: 0.184956 Sep 08 14:06:04.462414 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 402/800] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:04 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:05.491603 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-904664ca-3b29-4fc1-ad03-c23fbec1ccaa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:05.493454 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-904664ca-3b29-4fc1-ad03-c23fbec1ccaa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:05.501792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:05.505496 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=8 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:05.508133 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-904664ca-3b29-4fc1-ad03-c23fbec1ccaa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:05.508800 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-904664ca-3b29-4fc1-ad03-c23fbec1ccaa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:05.509781 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-904664ca-3b29-4fc1-ad03-c23fbec1ccaa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:05.510775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-904664ca-3b29-4fc1-ad03-c23fbec1ccaa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:05.511276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-904664ca-3b29-4fc1-ad03-c23fbec1ccaa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:05.511703 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-904664ca-3b29-4fc1-ad03-c23fbec1ccaa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:05.768154 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-904664ca-3b29-4fc1-ad03-c23fbec1ccaa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:05.777828 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-904664ca-3b29-4fc1-ad03-c23fbec1ccaa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1368 microversion: 2.1 time: 0.290986 Sep 08 14:06:05.778540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 399/801] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:05 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1368 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:06.801219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-29e52e95-b26c-491b-8898-e196b0cd04be tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:06.802507 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-29e52e95-b26c-491b-8898-e196b0cd04be tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:06.810243 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29e52e95-b26c-491b-8898-e196b0cd04be tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.810780 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29e52e95-b26c-491b-8898-e196b0cd04be tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.811241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29e52e95-b26c-491b-8898-e196b0cd04be tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.811940 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29e52e95-b26c-491b-8898-e196b0cd04be tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.812583 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29e52e95-b26c-491b-8898-e196b0cd04be tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.813173 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29e52e95-b26c-491b-8898-e196b0cd04be tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.987703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-29e52e95-b26c-491b-8898-e196b0cd04be tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:06.999313 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-29e52e95-b26c-491b-8898-e196b0cd04be tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1368 microversion: 2.1 time: 0.201835 Sep 08 14:06:06.999897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 403/802] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:06 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:08.022660 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-880bc30e-088b-4a55-9e72-649537630524 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:08.023425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-880bc30e-088b-4a55-9e72-649537630524 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:08.031416 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-880bc30e-088b-4a55-9e72-649537630524 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.032101 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-880bc30e-088b-4a55-9e72-649537630524 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.032612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-880bc30e-088b-4a55-9e72-649537630524 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.033472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-880bc30e-088b-4a55-9e72-649537630524 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.034042 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-880bc30e-088b-4a55-9e72-649537630524 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.038330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-880bc30e-088b-4a55-9e72-649537630524 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.198655 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-880bc30e-088b-4a55-9e72-649537630524 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:08.206353 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-880bc30e-088b-4a55-9e72-649537630524 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1368 microversion: 2.1 time: 0.187551 Sep 08 14:06:08.206942 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 400/803] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:08 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:08.863566 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-8a20a486-527e-4b11-96da-d0e22ea6ff99 req-861b2120-2ab0-4051-b1ef-f3f92d903464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e8a357-9c5c-41db-8440-b5ebe04b6c8c", "name": "network-vif-plugged", "status": "completed", "tag": "a93a84a1-d56f-4e9f-a443-a8184787c4a9"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:08.874325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-8a20a486-527e-4b11-96da-d0e22ea6ff99 req-861b2120-2ab0-4051-b1ef-f3f92d903464 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.874821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-8a20a486-527e-4b11-96da-d0e22ea6ff99 req-861b2120-2ab0-4051-b1ef-f3f92d903464 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.875514 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-8a20a486-527e-4b11-96da-d0e22ea6ff99 req-861b2120-2ab0-4051-b1ef-f3f92d903464 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.888555 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-8a20a486-527e-4b11-96da-d0e22ea6ff99 req-861b2120-2ab0-4051-b1ef-f3f92d903464 service nova] Creating event network-vif-plugged:a93a84a1-d56f-4e9f-a443-a8184787c4a9 for instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c on hv-cinder-84773 Sep 08 14:06:08.893813 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-8a20a486-527e-4b11-96da-d0e22ea6ff99 req-861b2120-2ab0-4051-b1ef-f3f92d903464 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150157 Sep 08 14:06:08.894807 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 404/804] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:09.237153 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-dac69092-9ef1-40cb-b43b-9ca8a55dc603 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:09.237629 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-dac69092-9ef1-40cb-b43b-9ca8a55dc603 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:09.244287 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dac69092-9ef1-40cb-b43b-9ca8a55dc603 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.245055 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dac69092-9ef1-40cb-b43b-9ca8a55dc603 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.245703 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dac69092-9ef1-40cb-b43b-9ca8a55dc603 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.246589 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dac69092-9ef1-40cb-b43b-9ca8a55dc603 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.247245 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dac69092-9ef1-40cb-b43b-9ca8a55dc603 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.247835 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-dac69092-9ef1-40cb-b43b-9ca8a55dc603 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.450824 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-dac69092-9ef1-40cb-b43b-9ca8a55dc603 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:09.459347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-dac69092-9ef1-40cb-b43b-9ca8a55dc603 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1368 microversion: 2.1 time: 0.233078 Sep 08 14:06:09.459927 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 401/805] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:09 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:10.484749 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=8 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:10.493406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-aa3a77dc-a2d0-4048-bd90-9e4fe29c4d4e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:10.494803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-aa3a77dc-a2d0-4048-bd90-9e4fe29c4d4e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:10.501404 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aa3a77dc-a2d0-4048-bd90-9e4fe29c4d4e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:10.508165 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aa3a77dc-a2d0-4048-bd90-9e4fe29c4d4e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.508165 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aa3a77dc-a2d0-4048-bd90-9e4fe29c4d4e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.508165 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aa3a77dc-a2d0-4048-bd90-9e4fe29c4d4e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:10.508165 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aa3a77dc-a2d0-4048-bd90-9e4fe29c4d4e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.508606 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aa3a77dc-a2d0-4048-bd90-9e4fe29c4d4e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.651482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-aa3a77dc-a2d0-4048-bd90-9e4fe29c4d4e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:10.659907 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-aa3a77dc-a2d0-4048-bd90-9e4fe29c4d4e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1368 microversion: 2.1 time: 0.179199 Sep 08 14:06:10.660487 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 405/806] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:10 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:11.684534 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c9efb56f-78d1-4563-a7ad-b0552a8b5f21 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:11.685883 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c9efb56f-78d1-4563-a7ad-b0552a8b5f21 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:11.694685 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c9efb56f-78d1-4563-a7ad-b0552a8b5f21 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.695198 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c9efb56f-78d1-4563-a7ad-b0552a8b5f21 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.695629 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c9efb56f-78d1-4563-a7ad-b0552a8b5f21 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.696327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c9efb56f-78d1-4563-a7ad-b0552a8b5f21 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.696776 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c9efb56f-78d1-4563-a7ad-b0552a8b5f21 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.697193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c9efb56f-78d1-4563-a7ad-b0552a8b5f21 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.843075 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c9efb56f-78d1-4563-a7ad-b0552a8b5f21 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:11.851195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c9efb56f-78d1-4563-a7ad-b0552a8b5f21 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1557 microversion: 2.1 time: 0.170877 Sep 08 14:06:11.851870 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 402/807] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:11 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:11.875573 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3a917e18-62d2-4ae5-a184-aa815269c7b5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:11.876814 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3a917e18-62d2-4ae5-a184-aa815269c7b5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:11.886324 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3a917e18-62d2-4ae5-a184-aa815269c7b5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.886979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3a917e18-62d2-4ae5-a184-aa815269c7b5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.887672 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3a917e18-62d2-4ae5-a184-aa815269c7b5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.888723 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3a917e18-62d2-4ae5-a184-aa815269c7b5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.889278 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3a917e18-62d2-4ae5-a184-aa815269c7b5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.891391 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3a917e18-62d2-4ae5-a184-aa815269c7b5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.985181 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3a917e18-62d2-4ae5-a184-aa815269c7b5 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113499 Sep 08 14:06:11.985841 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 406/808] 10.222.0.91 () {58 vars in 1275 bytes} [Thu Sep 8 14:06:11 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:12.624439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0a0a6adb-9f37-4d81-aadb-6034bc396f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:12.626845 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0a0a6adb-9f37-4d81-aadb-6034bc396f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:12.633163 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0a0a6adb-9f37-4d81-aadb-6034bc396f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:12.633705 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0a0a6adb-9f37-4d81-aadb-6034bc396f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:12.634084 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0a0a6adb-9f37-4d81-aadb-6034bc396f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:12.635195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0a0a6adb-9f37-4d81-aadb-6034bc396f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:12.635647 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0a0a6adb-9f37-4d81-aadb-6034bc396f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:12.636357 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0a0a6adb-9f37-4d81-aadb-6034bc396f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:12.684330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0a0a6adb-9f37-4d81-aadb-6034bc396f78 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063758 Sep 08 14:06:12.685242 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 403/809] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:06:12 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:12.701261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5b85192d-a43d-47e1-b1f2-cfa1370024b0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:12.709612 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5b85192d-a43d-47e1-b1f2-cfa1370024b0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:12.718663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5b85192d-a43d-47e1-b1f2-cfa1370024b0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:12.719207 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5b85192d-a43d-47e1-b1f2-cfa1370024b0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:12.720026 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5b85192d-a43d-47e1-b1f2-cfa1370024b0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:12.720937 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5b85192d-a43d-47e1-b1f2-cfa1370024b0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:12.721388 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5b85192d-a43d-47e1-b1f2-cfa1370024b0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:12.721812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5b85192d-a43d-47e1-b1f2-cfa1370024b0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:12.757751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5b85192d-a43d-47e1-b1f2-cfa1370024b0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments/868dbf4f-21e7-4047-8946-b0b7b24c1a07" status: 200 len: 194 microversion: 2.1 time: 0.064795 Sep 08 14:06:12.758392 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 407/810] 10.222.0.91 () {58 vars in 1413 bytes} [Thu Sep 8 14:06:12 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments/868dbf4f-21e7-4047-8946-b0b7b24c1a07 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:13.146391 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-12edf559-a9aa-4baf-bea1-5d90778b80d7 req-4f8388cc-34af-4f40-b0a6-f846dc960975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e8a357-9c5c-41db-8440-b5ebe04b6c8c", "tag": "a93a84a1-d56f-4e9f-a443-a8184787c4a9"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:13.161186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-12edf559-a9aa-4baf-bea1-5d90778b80d7 req-4f8388cc-34af-4f40-b0a6-f846dc960975 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:13.162698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-12edf559-a9aa-4baf-bea1-5d90778b80d7 req-4f8388cc-34af-4f40-b0a6-f846dc960975 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:13.163917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-12edf559-a9aa-4baf-bea1-5d90778b80d7 req-4f8388cc-34af-4f40-b0a6-f846dc960975 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:13.186412 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-12edf559-a9aa-4baf-bea1-5d90778b80d7 req-4f8388cc-34af-4f40-b0a6-f846dc960975 service nova] Creating event network-changed:a93a84a1-d56f-4e9f-a443-a8184787c4a9 for instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c on hv-cinder-84773 Sep 08 14:06:13.186412 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-12edf559-a9aa-4baf-bea1-5d90778b80d7 req-4f8388cc-34af-4f40-b0a6-f846dc960975 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044143 Sep 08 14:06:13.186412 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 404/811] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:14.588802 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ded28a8d-6fdd-42f6-b881-904bdc36d426 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9e35f4b-5512-4856-abc5-0ab9f4b2b100"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:14.591206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ded28a8d-6fdd-42f6-b881-904bdc36d426 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:14.600304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded28a8d-6fdd-42f6-b881-904bdc36d426 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:14.600754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded28a8d-6fdd-42f6-b881-904bdc36d426 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:14.601317 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded28a8d-6fdd-42f6-b881-904bdc36d426 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:14.602035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded28a8d-6fdd-42f6-b881-904bdc36d426 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:14.602489 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded28a8d-6fdd-42f6-b881-904bdc36d426 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:14.602940 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ded28a8d-6fdd-42f6-b881-904bdc36d426 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:15.562831 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ded28a8d-6fdd-42f6-b881-904bdc36d426 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "POST /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.979233 Sep 08 14:06:15.563610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 408/812] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:06:14 2022] POST /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments => generated 194 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:21.680487 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1248405342", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1027931487", "security_groups": [{"name": "tempest-secgroup-smoke-435232476"}], "networks": [{"uuid": "834341bf-e5d9-4de3-8095-df7ad402b4ba"}], "block_device_mapping_v2": [{"uuid": "af0bcd6a-f54e-4288-955d-b20a71fb24b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:21.800558 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] validate_networks() for [('834341bf-e5d9-4de3-8095-df7ad402b4ba', None, None, None, None, None)] {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:06:22.195922 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:06:22.203897 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:06:22.203897 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:06:22.203897 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:06:22.203897 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:06:22.206850 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:22.207380 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:22.207812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:22.208528 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:22.208979 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:22.209401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:22.225919 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Getting quotas for project 0d4361bb4c424b41aed6f6afa040df84. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:06:22.229907 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Getting quotas for user 30cfda5bb8284716935e7670bf44f647 and project 0d4361bb4c424b41aed6f6afa040df84. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:06:22.295585 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:06:22.297980 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af0bcd6a-f54e-4288-955d-b20a71fb24b5',volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:06:22.926593 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4c43cce9-1c7b-4be0-b2b6-fe0f1c2c307b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.251089 Sep 08 14:06:22.927337 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 405/813] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:06:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:06:22.940486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2e4a5dfe-719b-4887-b2f8-85484e97ded3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:22.941314 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2e4a5dfe-719b-4887-b2f8-85484e97ded3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:22.996770 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2e4a5dfe-719b-4887-b2f8-85484e97ded3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:23.007651 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2e4a5dfe-719b-4887-b2f8-85484e97ded3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1089 microversion: 2.1 time: 0.072032 Sep 08 14:06:23.009201 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 409/814] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:22 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:23.188488 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e8eae906-ccb3-4a57-9ccb-1278644f0acd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:23.189039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e8eae906-ccb3-4a57-9ccb-1278644f0acd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:23.195257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8eae906-ccb3-4a57-9ccb-1278644f0acd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:23.195745 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8eae906-ccb3-4a57-9ccb-1278644f0acd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:23.196183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8eae906-ccb3-4a57-9ccb-1278644f0acd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:23.196871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8eae906-ccb3-4a57-9ccb-1278644f0acd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:23.197353 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8eae906-ccb3-4a57-9ccb-1278644f0acd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:23.197770 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8eae906-ccb3-4a57-9ccb-1278644f0acd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:23.221814 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e8eae906-ccb3-4a57-9ccb-1278644f0acd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/ips" status: 200 len: 151 microversion: 2.20 time: 0.037383 Sep 08 14:06:23.222389 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 406/815] 10.222.0.91 () {60 vars in 1289 bytes} [Thu Sep 8 14:06:23 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:06:24.032387 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c920af02-0a49-46ec-bb61-36e3308cb3a9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:24.033218 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c920af02-0a49-46ec-bb61-36e3308cb3a9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:24.092254 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c920af02-0a49-46ec-bb61-36e3308cb3a9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:24.099839 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c920af02-0a49-46ec-bb61-36e3308cb3a9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1089 microversion: 2.1 time: 0.071361 Sep 08 14:06:24.100418 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 410/816] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:24 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:24.235798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-324d0cbe-144f-4999-ae48-58ee87d1e44f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:24.238010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-324d0cbe-144f-4999-ae48-58ee87d1e44f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:24.240558 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:24.245899 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-324d0cbe-144f-4999-ae48-58ee87d1e44f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.246388 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-324d0cbe-144f-4999-ae48-58ee87d1e44f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.246825 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-324d0cbe-144f-4999-ae48-58ee87d1e44f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.247550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-324d0cbe-144f-4999-ae48-58ee87d1e44f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.248002 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-324d0cbe-144f-4999-ae48-58ee87d1e44f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.248423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-324d0cbe-144f-4999-ae48-58ee87d1e44f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.278986 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-324d0cbe-144f-4999-ae48-58ee87d1e44f tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047237 Sep 08 14:06:24.279572 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 407/817] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:06:24 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:24.427689 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f451502e-ce20-4db1-aa3e-c88b6baa42f7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:24.428258 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f451502e-ce20-4db1-aa3e-c88b6baa42f7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:24.435463 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f451502e-ce20-4db1-aa3e-c88b6baa42f7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.435967 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f451502e-ce20-4db1-aa3e-c88b6baa42f7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.436503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f451502e-ce20-4db1-aa3e-c88b6baa42f7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.437154 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f451502e-ce20-4db1-aa3e-c88b6baa42f7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.437480 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f451502e-ce20-4db1-aa3e-c88b6baa42f7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.437900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f451502e-ce20-4db1-aa3e-c88b6baa42f7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.468632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f451502e-ce20-4db1-aa3e-c88b6baa42f7 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments/868dbf4f-21e7-4047-8946-b0b7b24c1a07" status: 200 len: 194 microversion: 2.1 time: 0.045402 Sep 08 14:06:24.469237 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 411/818] 10.222.0.91 () {58 vars in 1413 bytes} [Thu Sep 8 14:06:24 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments/868dbf4f-21e7-4047-8946-b0b7b24c1a07 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:24.486194 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f11e36a9-b549-4637-8d21-045f87f9f2e3 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:24.486692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f11e36a9-b549-4637-8d21-045f87f9f2e3 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:24.493962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f11e36a9-b549-4637-8d21-045f87f9f2e3 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.494979 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f11e36a9-b549-4637-8d21-045f87f9f2e3 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.495443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f11e36a9-b549-4637-8d21-045f87f9f2e3 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.496376 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f11e36a9-b549-4637-8d21-045f87f9f2e3 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.496835 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f11e36a9-b549-4637-8d21-045f87f9f2e3 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.497417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f11e36a9-b549-4637-8d21-045f87f9f2e3 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.587337 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-f11e36a9-b549-4637-8d21-045f87f9f2e3 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lazy-loading 'services' on Instance uuid 02257583-1cd3-4c60-9fd9-72bd2c16425e {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:06:24.801863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f11e36a9-b549-4637-8d21-045f87f9f2e3 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "DELETE /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments/868dbf4f-21e7-4047-8946-b0b7b24c1a07" status: 202 len: 0 microversion: 2.1 time: 0.325772 Sep 08 14:06:24.802476 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 408/819] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:06:24 2022] DELETE /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments/868dbf4f-21e7-4047-8946-b0b7b24c1a07 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:25.125153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-53c62444-60e2-4e9c-baae-340f27e2cd6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:25.125769 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-53c62444-60e2-4e9c-baae-340f27e2cd6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:25.132803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53c62444-60e2-4e9c-baae-340f27e2cd6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:25.133288 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53c62444-60e2-4e9c-baae-340f27e2cd6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:25.133727 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53c62444-60e2-4e9c-baae-340f27e2cd6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:25.134421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53c62444-60e2-4e9c-baae-340f27e2cd6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:25.134874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53c62444-60e2-4e9c-baae-340f27e2cd6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:25.135364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-53c62444-60e2-4e9c-baae-340f27e2cd6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:25.203751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-53c62444-60e2-4e9c-baae-340f27e2cd6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:25.212586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-53c62444-60e2-4e9c-baae-340f27e2cd6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1187 microversion: 2.1 time: 0.091212 Sep 08 14:06:25.213175 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 412/820] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:25 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:25.564020 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7a0b206b-326d-4953-8d19-842fe104ab2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:25.564644 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7a0b206b-326d-4953-8d19-842fe104ab2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:25.571039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a0b206b-326d-4953-8d19-842fe104ab2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:25.571532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a0b206b-326d-4953-8d19-842fe104ab2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:25.571973 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a0b206b-326d-4953-8d19-842fe104ab2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:25.573345 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a0b206b-326d-4953-8d19-842fe104ab2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:25.573810 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a0b206b-326d-4953-8d19-842fe104ab2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:25.574361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a0b206b-326d-4953-8d19-842fe104ab2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:25.597894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-7a0b206b-326d-4953-8d19-842fe104ab2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lazy-loading 'flavor' on Instance uuid b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:06:26.174972 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7a0b206b-326d-4953-8d19-842fe104ab2d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "POST /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/action" status: 202 len: 0 microversion: 2.20 time: 0.615516 Sep 08 14:06:26.175646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 409/821] 10.222.0.91 () {62 vars in 1319 bytes} [Thu Sep 8 14:06:25 2022] POST /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:06:26.187815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:26.189259 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:26.197823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:26.198316 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:26.198753 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:26.199749 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:26.200285 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:26.200720 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:26.239782 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2ba7fe48-236c-4a31-8a91-ed9194e99856 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:26.240462 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2ba7fe48-236c-4a31-8a91-ed9194e99856 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:26.266348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ba7fe48-236c-4a31-8a91-ed9194e99856 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:26.266864 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ba7fe48-236c-4a31-8a91-ed9194e99856 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:26.267390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ba7fe48-236c-4a31-8a91-ed9194e99856 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:26.268305 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ba7fe48-236c-4a31-8a91-ed9194e99856 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:26.268930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ba7fe48-236c-4a31-8a91-ed9194e99856 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:26.269712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2ba7fe48-236c-4a31-8a91-ed9194e99856 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:26.293410 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:26.343597 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2ba7fe48-236c-4a31-8a91-ed9194e99856 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:26.354985 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2ba7fe48-236c-4a31-8a91-ed9194e99856 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1187 microversion: 2.1 time: 0.119140 Sep 08 14:06:26.356187 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 410/822] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:26 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:26.382174 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:26.392757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:26.394214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:26.395444 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b50ccb86-4012-477a-a046-b8295f25e9c1 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.212421 Sep 08 14:06:26.396013 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 413/823] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:26 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:27.030722 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c49d0d59-5864-417b-9f66-c6db62bd9bc1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:27.031172 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c49d0d59-5864-417b-9f66-c6db62bd9bc1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:27.039066 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c49d0d59-5864-417b-9f66-c6db62bd9bc1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.039636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c49d0d59-5864-417b-9f66-c6db62bd9bc1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.040303 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c49d0d59-5864-417b-9f66-c6db62bd9bc1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.041820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c49d0d59-5864-417b-9f66-c6db62bd9bc1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.042558 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c49d0d59-5864-417b-9f66-c6db62bd9bc1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.043251 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c49d0d59-5864-417b-9f66-c6db62bd9bc1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.075206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c49d0d59-5864-417b-9f66-c6db62bd9bc1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments/e9e35f4b-5512-4856-abc5-0ab9f4b2b100" status: 200 len: 194 microversion: 2.1 time: 0.049050 Sep 08 14:06:27.075820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 411/824] 10.222.0.91 () {58 vars in 1413 bytes} [Thu Sep 8 14:06:27 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments/e9e35f4b-5512-4856-abc5-0ab9f4b2b100 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:27.086927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ad0e74f5-61a8-40e8-8c80-61db38ce9ea2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:27.088232 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ad0e74f5-61a8-40e8-8c80-61db38ce9ea2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:27.094682 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad0e74f5-61a8-40e8-8c80-61db38ce9ea2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.095358 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad0e74f5-61a8-40e8-8c80-61db38ce9ea2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.095874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad0e74f5-61a8-40e8-8c80-61db38ce9ea2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.096747 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad0e74f5-61a8-40e8-8c80-61db38ce9ea2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.097259 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad0e74f5-61a8-40e8-8c80-61db38ce9ea2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.097823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad0e74f5-61a8-40e8-8c80-61db38ce9ea2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.117505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:27.185064 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-ad0e74f5-61a8-40e8-8c80-61db38ce9ea2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lazy-loading 'services' on Instance uuid 02257583-1cd3-4c60-9fd9-72bd2c16425e {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:06:27.379987 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-15a2d217-20a7-40f3-b75d-f3c1e42872d4 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:27.380596 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-15a2d217-20a7-40f3-b75d-f3c1e42872d4 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:27.387520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-15a2d217-20a7-40f3-b75d-f3c1e42872d4 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.387944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-15a2d217-20a7-40f3-b75d-f3c1e42872d4 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.388380 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-15a2d217-20a7-40f3-b75d-f3c1e42872d4 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.389160 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-15a2d217-20a7-40f3-b75d-f3c1e42872d4 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.389614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-15a2d217-20a7-40f3-b75d-f3c1e42872d4 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.390039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-15a2d217-20a7-40f3-b75d-f3c1e42872d4 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.431290 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ad0e74f5-61a8-40e8-8c80-61db38ce9ea2 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "DELETE /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments/e9e35f4b-5512-4856-abc5-0ab9f4b2b100" status: 202 len: 0 microversion: 2.1 time: 0.348073 Sep 08 14:06:27.432673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 414/825] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:06:27 2022] DELETE /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments/e9e35f4b-5512-4856-abc5-0ab9f4b2b100 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:27.450120 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:27.451129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:27.454127 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:27.461072 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.463027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.463872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.464852 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.466087 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.466716 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.570437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-15a2d217-20a7-40f3-b75d-f3c1e42872d4 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:27.582226 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-15a2d217-20a7-40f3-b75d-f3c1e42872d4 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1272 microversion: 2.1 time: 0.206821 Sep 08 14:06:27.582982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 412/826] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:27 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:27.698037 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:27.713724 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:27.715092 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:27.716262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5352f82b-f2fd-46c7-bf35-d62905e1bdf9 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.282284 Sep 08 14:06:27.716812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 415/827] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:27 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:28.513385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-ec3b0d24-f7a2-4795-8c29-62fb801eee91 req-b599e628-101b-4ead-9fa6-b4e05ff74cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e11d590-d8c5-4b4a-ba5d-0a0ae203954b", "tag": "2bb33aac-6854-44c1-9bf8-4f4c73e872c4"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:28.516627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-ec3b0d24-f7a2-4795-8c29-62fb801eee91 req-b599e628-101b-4ead-9fa6-b4e05ff74cbc service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.517097 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-ec3b0d24-f7a2-4795-8c29-62fb801eee91 req-b599e628-101b-4ead-9fa6-b4e05ff74cbc service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.517525 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-ec3b0d24-f7a2-4795-8c29-62fb801eee91 req-b599e628-101b-4ead-9fa6-b4e05ff74cbc service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:28.530228 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-ec3b0d24-f7a2-4795-8c29-62fb801eee91 req-b599e628-101b-4ead-9fa6-b4e05ff74cbc service nova] Creating event network-changed:2bb33aac-6854-44c1-9bf8-4f4c73e872c4 for instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b on hv-cinder-84773 Sep 08 14:06:28.536058 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-ec3b0d24-f7a2-4795-8c29-62fb801eee91 req-b599e628-101b-4ead-9fa6-b4e05ff74cbc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033692 Sep 08 14:06:28.537002 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 413/828] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:28.607671 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4d08030d-f66a-4ec0-b750-c907e82be10a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:28.608304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4d08030d-f66a-4ec0-b750-c907e82be10a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:28.616120 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d08030d-f66a-4ec0-b750-c907e82be10a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.616610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d08030d-f66a-4ec0-b750-c907e82be10a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.617035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d08030d-f66a-4ec0-b750-c907e82be10a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:28.617932 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d08030d-f66a-4ec0-b750-c907e82be10a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.618380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d08030d-f66a-4ec0-b750-c907e82be10a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.618816 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d08030d-f66a-4ec0-b750-c907e82be10a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:28.744928 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:28.745542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:28.752031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.752519 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.752963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:28.753659 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.754110 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.754534 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:28.760266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4d08030d-f66a-4ec0-b750-c907e82be10a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:28.768911 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4d08030d-f66a-4ec0-b750-c907e82be10a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1272 microversion: 2.1 time: 0.165860 Sep 08 14:06:28.769504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 416/829] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:28 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:28.915432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:28.934698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:28.936415 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:28.937762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6b848d44-03c2-4636-8298-45c2a0bc729d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.197481 Sep 08 14:06:28.938696 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 414/830] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:28 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:06:29.725686 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-dd8dce9e-d399-4e9c-a5cb-18124799b2ab tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:29.728728 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-dd8dce9e-d399-4e9c-a5cb-18124799b2ab tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:29.735808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dd8dce9e-d399-4e9c-a5cb-18124799b2ab tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.736300 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dd8dce9e-d399-4e9c-a5cb-18124799b2ab tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.736741 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dd8dce9e-d399-4e9c-a5cb-18124799b2ab tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.737449 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dd8dce9e-d399-4e9c-a5cb-18124799b2ab tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.737910 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dd8dce9e-d399-4e9c-a5cb-18124799b2ab tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.738332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-dd8dce9e-d399-4e9c-a5cb-18124799b2ab tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.770792 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-dd8dce9e-d399-4e9c-a5cb-18124799b2ab tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051310 Sep 08 14:06:29.771740 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 417/831] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:06:29 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:06:29.792852 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ba37cf90-8a68-4f8d-8a42-76741e9e5976 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:29.793620 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ba37cf90-8a68-4f8d-8a42-76741e9e5976 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:29.800161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ba37cf90-8a68-4f8d-8a42-76741e9e5976 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.800886 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ba37cf90-8a68-4f8d-8a42-76741e9e5976 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.801326 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ba37cf90-8a68-4f8d-8a42-76741e9e5976 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.802155 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ba37cf90-8a68-4f8d-8a42-76741e9e5976 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.803482 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ba37cf90-8a68-4f8d-8a42-76741e9e5976 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.804315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ba37cf90-8a68-4f8d-8a42-76741e9e5976 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.903442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b17e8a1a-3a11-4963-8c76-dd1be59f6ae5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:29.905627 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b17e8a1a-3a11-4963-8c76-dd1be59f6ae5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:29.912178 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b17e8a1a-3a11-4963-8c76-dd1be59f6ae5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.912664 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b17e8a1a-3a11-4963-8c76-dd1be59f6ae5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.913099 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b17e8a1a-3a11-4963-8c76-dd1be59f6ae5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.913805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b17e8a1a-3a11-4963-8c76-dd1be59f6ae5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.914255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b17e8a1a-3a11-4963-8c76-dd1be59f6ae5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.914677 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b17e8a1a-3a11-4963-8c76-dd1be59f6ae5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.945441 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b17e8a1a-3a11-4963-8c76-dd1be59f6ae5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046596 Sep 08 14:06:29.949998 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 418/832] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:06:29 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:06:29.952862 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ba37cf90-8a68-4f8d-8a42-76741e9e5976 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:29.961260 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ba37cf90-8a68-4f8d-8a42-76741e9e5976 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1260 microversion: 2.1 time: 0.172560 Sep 08 14:06:29.961969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 415/833] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:29 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:29.965245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:29.965955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:29.972983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.973586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.974113 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.974926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.975479 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.976002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:30.024527 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3e922caa-a7fd-4f59-9d56-e2d4dfc82807 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:30.025694 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3e922caa-a7fd-4f59-9d56-e2d4dfc82807 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:30.032126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e922caa-a7fd-4f59-9d56-e2d4dfc82807 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:30.032628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e922caa-a7fd-4f59-9d56-e2d4dfc82807 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:30.033064 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e922caa-a7fd-4f59-9d56-e2d4dfc82807 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:30.033779 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e922caa-a7fd-4f59-9d56-e2d4dfc82807 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:30.034233 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e922caa-a7fd-4f59-9d56-e2d4dfc82807 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:30.034661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e922caa-a7fd-4f59-9d56-e2d4dfc82807 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:30.060617 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3e922caa-a7fd-4f59-9d56-e2d4dfc82807 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:06:30.128193 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:30.136352 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:30.137782 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:30.138986 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-93820274-c28a-4c95-8074-e0213745c877 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.178992 Sep 08 14:06:30.146272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 419/834] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:29 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:30.396915 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3e922caa-a7fd-4f59-9d56-e2d4dfc82807 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "DELETE /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 204 len: 0 microversion: 2.1 time: 0.376543 Sep 08 14:06:30.398074 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 416/835] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:06:30 2022] DELETE /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:06:30.407106 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-93e4a073-fd25-4db2-9a83-de94ab06e10a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:30.407755 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-93e4a073-fd25-4db2-9a83-de94ab06e10a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:30.413954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93e4a073-fd25-4db2-9a83-de94ab06e10a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:30.414445 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93e4a073-fd25-4db2-9a83-de94ab06e10a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:30.414886 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93e4a073-fd25-4db2-9a83-de94ab06e10a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:30.415626 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93e4a073-fd25-4db2-9a83-de94ab06e10a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:30.416099 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93e4a073-fd25-4db2-9a83-de94ab06e10a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:30.416529 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-93e4a073-fd25-4db2-9a83-de94ab06e10a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:30.563784 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-93e4a073-fd25-4db2-9a83-de94ab06e10a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:30.572298 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-93e4a073-fd25-4db2-9a83-de94ab06e10a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1673 microversion: 2.1 time: 0.168737 Sep 08 14:06:30.572888 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 420/836] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:30 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:30.986747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8bffa58b-4bd0-4ceb-b748-d9ade45b1cd7 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:30.987528 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8bffa58b-4bd0-4ceb-b748-d9ade45b1cd7 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:30.994601 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bffa58b-4bd0-4ceb-b748-d9ade45b1cd7 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:30.995134 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bffa58b-4bd0-4ceb-b748-d9ade45b1cd7 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:30.995569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bffa58b-4bd0-4ceb-b748-d9ade45b1cd7 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:30.996250 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bffa58b-4bd0-4ceb-b748-d9ade45b1cd7 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:30.996697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bffa58b-4bd0-4ceb-b748-d9ade45b1cd7 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:30.997116 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bffa58b-4bd0-4ceb-b748-d9ade45b1cd7 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:31.137207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8bffa58b-4bd0-4ceb-b748-d9ade45b1cd7 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:31.146134 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8bffa58b-4bd0-4ceb-b748-d9ade45b1cd7 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1260 microversion: 2.1 time: 0.164244 Sep 08 14:06:31.146714 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 417/837] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:30 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:31.164845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:31.166047 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:31.172911 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:31.173459 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:31.173895 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:31.174605 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:31.175095 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:31.175521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:31.318678 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:31.328382 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:31.329842 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:31.331050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7e9a8f65-e268-44cc-b4da-de0fbe3b12bb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.170149 Sep 08 14:06:31.331753 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 421/838] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:31 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:31.597287 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d37e010f-21fc-4986-baff-f3a2ab28daa5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:31.597901 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d37e010f-21fc-4986-baff-f3a2ab28daa5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:31.604652 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d37e010f-21fc-4986-baff-f3a2ab28daa5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:31.605162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d37e010f-21fc-4986-baff-f3a2ab28daa5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:31.605601 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d37e010f-21fc-4986-baff-f3a2ab28daa5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:31.606291 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d37e010f-21fc-4986-baff-f3a2ab28daa5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:31.606766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d37e010f-21fc-4986-baff-f3a2ab28daa5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:31.607246 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d37e010f-21fc-4986-baff-f3a2ab28daa5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:31.740455 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d37e010f-21fc-4986-baff-f3a2ab28daa5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:31.748355 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d37e010f-21fc-4986-baff-f3a2ab28daa5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1673 microversion: 2.1 time: 0.154866 Sep 08 14:06:31.748964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 418/839] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:31 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:32.169975 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1f3a7ccd-031f-4d6d-a8e0-496dde5b68c9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:32.170775 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1f3a7ccd-031f-4d6d-a8e0-496dde5b68c9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:32.178280 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f3a7ccd-031f-4d6d-a8e0-496dde5b68c9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:32.178807 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f3a7ccd-031f-4d6d-a8e0-496dde5b68c9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:32.179271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f3a7ccd-031f-4d6d-a8e0-496dde5b68c9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:32.180472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f3a7ccd-031f-4d6d-a8e0-496dde5b68c9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:32.180472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f3a7ccd-031f-4d6d-a8e0-496dde5b68c9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:32.181471 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f3a7ccd-031f-4d6d-a8e0-496dde5b68c9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:32.339108 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1f3a7ccd-031f-4d6d-a8e0-496dde5b68c9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:32.347272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1f3a7ccd-031f-4d6d-a8e0-496dde5b68c9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1260 microversion: 2.1 time: 0.181693 Sep 08 14:06:32.347852 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 422/840] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:32 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:32.357980 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:32.358848 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:32.361397 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:32.362074 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=6 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:32.367183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:32.367676 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:32.368114 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:32.369395 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:32.369851 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:32.370273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:32.523857 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:32.534381 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:32.535858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:32.537029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-91e43551-3119-48a6-947f-7c5070fe5c45 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.183136 Sep 08 14:06:32.537782 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 419/841] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:32 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:32.772420 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e3923beb-8336-4567-bc8c-b400015d8b26 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:32.773025 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e3923beb-8336-4567-bc8c-b400015d8b26 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:32.779535 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3923beb-8336-4567-bc8c-b400015d8b26 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:32.780032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3923beb-8336-4567-bc8c-b400015d8b26 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:32.780472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3923beb-8336-4567-bc8c-b400015d8b26 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:32.781324 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3923beb-8336-4567-bc8c-b400015d8b26 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:32.781764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3923beb-8336-4567-bc8c-b400015d8b26 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:32.782213 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e3923beb-8336-4567-bc8c-b400015d8b26 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.018425 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e3923beb-8336-4567-bc8c-b400015d8b26 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:33.027406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e3923beb-8336-4567-bc8c-b400015d8b26 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1673 microversion: 2.1 time: 0.258712 Sep 08 14:06:33.027997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 423/842] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:32 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:33.369986 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-09e0d949-57b6-4a3f-be90-f34b04c4fd0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:33.370590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-09e0d949-57b6-4a3f-be90-f34b04c4fd0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:33.377639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09e0d949-57b6-4a3f-be90-f34b04c4fd0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.378129 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09e0d949-57b6-4a3f-be90-f34b04c4fd0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.378569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09e0d949-57b6-4a3f-be90-f34b04c4fd0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.379298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09e0d949-57b6-4a3f-be90-f34b04c4fd0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.379751 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09e0d949-57b6-4a3f-be90-f34b04c4fd0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.380170 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-09e0d949-57b6-4a3f-be90-f34b04c4fd0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.526504 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-09e0d949-57b6-4a3f-be90-f34b04c4fd0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:33.534445 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-09e0d949-57b6-4a3f-be90-f34b04c4fd0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1260 microversion: 2.1 time: 0.168404 Sep 08 14:06:33.535061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 420/843] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:33 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:33.563086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:33.563703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:33.572100 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.572100 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.572100 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.572577 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.572872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.573305 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.800454 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-357ea8f5-ae59-49ca-83ef-6426127a4075 req-a0b57d0a-f73a-4633-b124-ce65fec52140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02257583-1cd3-4c60-9fd9-72bd2c16425e", "name": "network-vif-deleted", "tag": "49ca98e0-9d14-4595-804a-6e918c13b9f0"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:33.811341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-357ea8f5-ae59-49ca-83ef-6426127a4075 req-a0b57d0a-f73a-4633-b124-ce65fec52140 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.812095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-357ea8f5-ae59-49ca-83ef-6426127a4075 req-a0b57d0a-f73a-4633-b124-ce65fec52140 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.812688 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-357ea8f5-ae59-49ca-83ef-6426127a4075 req-a0b57d0a-f73a-4633-b124-ce65fec52140 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.826284 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-357ea8f5-ae59-49ca-83ef-6426127a4075 req-a0b57d0a-f73a-4633-b124-ce65fec52140 service nova] Creating event network-vif-deleted:49ca98e0-9d14-4595-804a-6e918c13b9f0 for instance 02257583-1cd3-4c60-9fd9-72bd2c16425e on hv-cinder-84773 Sep 08 14:06:33.830284 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:33.838427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-357ea8f5-ae59-49ca-83ef-6426127a4075 req-a0b57d0a-f73a-4633-b124-ce65fec52140 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042077 Sep 08 14:06:33.839683 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 421/844] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:06:33.840844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:33.842595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:33.843814 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1eeea492-57a5-4ddc-a622-4d2fe92b0956 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.284748 Sep 08 14:06:33.844661 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 424/845] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:33 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:34.052726 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fc928f96-fa8f-4f0f-b282-1a0bda7a495a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:34.053785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-fc928f96-fa8f-4f0f-b282-1a0bda7a495a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:34.061346 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc928f96-fa8f-4f0f-b282-1a0bda7a495a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:34.062167 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc928f96-fa8f-4f0f-b282-1a0bda7a495a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:34.062832 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc928f96-fa8f-4f0f-b282-1a0bda7a495a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:34.063847 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc928f96-fa8f-4f0f-b282-1a0bda7a495a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:34.064508 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc928f96-fa8f-4f0f-b282-1a0bda7a495a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:34.069577 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fc928f96-fa8f-4f0f-b282-1a0bda7a495a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:34.136069 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-fc928f96-fa8f-4f0f-b282-1a0bda7a495a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b403bdc9cad4783b72bbf174199363c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0ed4e4f54c47369721e871f0dec518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:34.144156 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-fc928f96-fa8f-4f0f-b282-1a0bda7a495a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 200 len: 1322 microversion: 2.1 time: 0.095665 Sep 08 14:06:34.145454 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 422/846] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:34 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 1322 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:34.559570 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-fc754551-3569-4650-a84f-bff2d6d545b5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:34.564608 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-fc754551-3569-4650-a84f-bff2d6d545b5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:34.568107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=4 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:34.570551 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc754551-3569-4650-a84f-bff2d6d545b5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:34.570860 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc754551-3569-4650-a84f-bff2d6d545b5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:34.571428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc754551-3569-4650-a84f-bff2d6d545b5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:34.572086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc754551-3569-4650-a84f-bff2d6d545b5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:34.572541 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc754551-3569-4650-a84f-bff2d6d545b5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:34.572961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-fc754551-3569-4650-a84f-bff2d6d545b5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:34.725028 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-fc754551-3569-4650-a84f-bff2d6d545b5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:34.741880 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-fc754551-3569-4650-a84f-bff2d6d545b5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1260 microversion: 2.1 time: 0.187006 Sep 08 14:06:34.743236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 425/847] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:34 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:34.872057 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:34.873538 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:34.881569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:34.882055 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:34.885815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:34.885815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:34.885815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:34.885815 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:35.059303 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:35.069957 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:35.075067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:35.075067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-06258b43-29c0-4df3-8aaa-1d90f6184854 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.205333 Sep 08 14:06:35.075067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 423/848] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:34 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:35.168391 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:35.169113 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:35.175579 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:35.176177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:35.176703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:35.177470 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:35.177990 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:35.178486 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:35.196153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] HTTP exception thrown: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Request method failure captured: Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e HTTP/1.1 Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVW0XblqzpKmD2u__hW2kio_fYuPre3cdiVNc1KOI02xERtcRS_DW5g-pUqNQxzC1Iaoj3qt_Px8yIWJBNdKjP5HdvYGhc_yB6dVQqSLuxkKWTvf56A5lJQpk9nVErxCKwceaG15aRC1IF6njBqK4-MhF2EKwi9O6hPNNch_WuBjr0 Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:06:35.198359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_4d0ed4e4f54c47369721e871f0dec518", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 7b403bdc9cad4783b72bbf174199363c Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:35.200219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '02257583-1cd3-4c60-9fd9-72bd2c16425e'} Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:06:35.201057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:35.202666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:35.204023 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Returning 404 to user: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:06:35.204023 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e165d6aa-5609-40ef-98e1-8d88aef7f0e0 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 404 len: 111 microversion: 2.1 time: 0.035427 Sep 08 14:06:35.204023 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 426/849] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:35 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:06:35.209026 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b3850adb-da2b-44b5-a3ae-7b45126e9091 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '.version_select at 0x7f51fbfeeb80>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:35.308575 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b3850adb-da2b-44b5-a3ae-7b45126e9091 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872289263" status: 202 len: 0 microversion: 2.1 time: 0.103483 Sep 08 14:06:35.309188 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 424/850] 10.222.0.91 () {58 vars in 1218 bytes} [Thu Sep 8 14:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872289263 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:35.766418 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5bf5e4e6-6fde-42d5-9714-6b7fe362bcf8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:35.767105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5bf5e4e6-6fde-42d5-9714-6b7fe362bcf8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:35.778110 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bf5e4e6-6fde-42d5-9714-6b7fe362bcf8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:35.778609 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bf5e4e6-6fde-42d5-9714-6b7fe362bcf8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:35.779089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bf5e4e6-6fde-42d5-9714-6b7fe362bcf8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:35.779876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bf5e4e6-6fde-42d5-9714-6b7fe362bcf8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:35.780340 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bf5e4e6-6fde-42d5-9714-6b7fe362bcf8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:35.780766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5bf5e4e6-6fde-42d5-9714-6b7fe362bcf8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:36.003715 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5bf5e4e6-6fde-42d5-9714-6b7fe362bcf8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:36.012622 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5bf5e4e6-6fde-42d5-9714-6b7fe362bcf8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1260 microversion: 2.1 time: 0.250178 Sep 08 14:06:36.013200 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 427/851] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:35 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:36.102500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:36.103154 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:36.109118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:36.109615 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:36.110059 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:36.110789 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:36.111289 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:36.111717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:36.262673 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:36.271583 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:36.273031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:36.274454 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ad440cca-5190-46f5-9b42-b9eadb446061 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.176705 Sep 08 14:06:36.275142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 425/852] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:36 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:37.036568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0c7a5152-857e-42fb-8957-323f0023c3fc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:37.037179 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-0c7a5152-857e-42fb-8957-323f0023c3fc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:37.043827 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0c7a5152-857e-42fb-8957-323f0023c3fc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:37.044304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0c7a5152-857e-42fb-8957-323f0023c3fc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:37.044729 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0c7a5152-857e-42fb-8957-323f0023c3fc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:37.045415 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0c7a5152-857e-42fb-8957-323f0023c3fc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:37.048325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0c7a5152-857e-42fb-8957-323f0023c3fc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:37.048325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-0c7a5152-857e-42fb-8957-323f0023c3fc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:37.192092 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-0c7a5152-857e-42fb-8957-323f0023c3fc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:37.200307 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0c7a5152-857e-42fb-8957-323f0023c3fc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1260 microversion: 2.1 time: 0.168072 Sep 08 14:06:37.200868 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 428/853] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:37 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:37.300439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:37.301267 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:37.308255 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:37.308737 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:37.309170 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:37.309860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:37.310317 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:37.310737 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:37.460783 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:37.474432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:37.477120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:37.478824 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d755552a-4758-4ce1-a44b-446ec7dd47df tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.182055 Sep 08 14:06:37.479553 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 426/854] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:37 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:06:38.224381 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1dd80e0f-4153-46ac-848f-654dcd4e21e3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:38.225209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1dd80e0f-4153-46ac-848f-654dcd4e21e3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:38.232469 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1dd80e0f-4153-46ac-848f-654dcd4e21e3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.233072 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1dd80e0f-4153-46ac-848f-654dcd4e21e3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.233498 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1dd80e0f-4153-46ac-848f-654dcd4e21e3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.234064 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1dd80e0f-4153-46ac-848f-654dcd4e21e3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.234518 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1dd80e0f-4153-46ac-848f-654dcd4e21e3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.234961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1dd80e0f-4153-46ac-848f-654dcd4e21e3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.367856 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1dd80e0f-4153-46ac-848f-654dcd4e21e3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:38.376595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1dd80e0f-4153-46ac-848f-654dcd4e21e3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1260 microversion: 2.1 time: 0.156483 Sep 08 14:06:38.377238 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 429/855] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:38 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:38.517805 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:38.518405 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:38.525138 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.525625 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.526057 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.526749 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.527253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.527671 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.767240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-f1fad66b-2fcb-4a36-982a-6117fd7662a0 req-740847a9-0569-4e05-b05e-bf5f01c3ce9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e11d590-d8c5-4b4a-ba5d-0a0ae203954b", "name": "network-vif-plugged", "status": "completed", "tag": "2bb33aac-6854-44c1-9bf8-4f4c73e872c4"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:38.789637 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-f1fad66b-2fcb-4a36-982a-6117fd7662a0 req-740847a9-0569-4e05-b05e-bf5f01c3ce9e service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.791871 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-f1fad66b-2fcb-4a36-982a-6117fd7662a0 req-740847a9-0569-4e05-b05e-bf5f01c3ce9e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.792200 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-f1fad66b-2fcb-4a36-982a-6117fd7662a0 req-740847a9-0569-4e05-b05e-bf5f01c3ce9e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.808943 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-f1fad66b-2fcb-4a36-982a-6117fd7662a0 req-740847a9-0569-4e05-b05e-bf5f01c3ce9e service nova] Creating event network-vif-plugged:2bb33aac-6854-44c1-9bf8-4f4c73e872c4 for instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b on hv-cinder-84773 Sep 08 14:06:38.814086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-f1fad66b-2fcb-4a36-982a-6117fd7662a0 req-740847a9-0569-4e05-b05e-bf5f01c3ce9e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052776 Sep 08 14:06:38.814947 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 430/856] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:06:38.820211 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:38.820952 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:38.827367 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.827929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.828561 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.829270 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.829958 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.830635 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.837650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:38.842687 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:38.847517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] HTTP exception thrown: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:38.848238 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Request method failure captured: Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: DELETE /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e HTTP/1.1 Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVW0XblqzpKmD2u__hW2kio_fYuPre3cdiVNc1KOI02xERtcRS_DW5g-pUqNQxzC1Iaoj3qt_Px8yIWJBNdKjP5HdvYGhc_yB6dVQqSLuxkKWTvf56A5lJQpk9nVErxCKwceaG15aRC1IF6njBqK4-MhF2EKwi9O6hPNNch_WuBjr0 Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:06:38.849215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_4d0ed4e4f54c47369721e871f0dec518", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 7b403bdc9cad4783b72bbf174199363c Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:38.850921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '02257583-1cd3-4c60-9fd9-72bd2c16425e'} Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:06:38.851810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:38.854437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:38.855905 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:38.855905 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a0cc76e3-c946-467d-8e57-8e48b799de5d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.337099 Sep 08 14:06:38.855905 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 427/857] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:38 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:38.856178 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Returning 404 to user: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:06:38.856676 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-75fdc5d1-ece7-4bc8-97e4-491ef84a004a tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "DELETE /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 404 len: 111 microversion: 2.1 time: 0.040601 Sep 08 14:06:38.857233 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 431/858] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:06:38 2022] DELETE /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:06:38.865223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:38.866012 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: 02257583-1cd3-4c60-9fd9-72bd2c16425e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:38.873740 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.875403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.875403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.875933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.876570 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.877027 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.891976 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] HTTP exception thrown: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Request method failure captured: Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e HTTP/1.1 Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVW0XblqzpKmD2u__hW2kio_fYuPre3cdiVNc1KOI02xERtcRS_DW5g-pUqNQxzC1Iaoj3qt_Px8yIWJBNdKjP5HdvYGhc_yB6dVQqSLuxkKWTvf56A5lJQpk9nVErxCKwceaG15aRC1IF6njBqK4-MhF2EKwi9O6hPNNch_WuBjr0 Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:06:38.893820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_4d0ed4e4f54c47369721e871f0dec518", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 7b403bdc9cad4783b72bbf174199363c Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:38.895432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '02257583-1cd3-4c60-9fd9-72bd2c16425e'} Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:06:38.896311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. Sep 08 14:06:38.897795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:38.899417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Returning 404 to user: Instance 02257583-1cd3-4c60-9fd9-72bd2c16425e could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:06:38.903623 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-12f8cb2a-a23b-4fcd-9580-f1f3ecd611c5 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e" status: 404 len: 111 microversion: 2.1 time: 0.042199 Sep 08 14:06:38.904280 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 428/859] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:38 2022] GET /compute/v2.1/servers/02257583-1cd3-4c60-9fd9-72bd2c16425e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:06:39.401897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-093a6f5b-c448-40a4-b13f-5d92273378cb tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:39.402513 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-093a6f5b-c448-40a4-b13f-5d92273378cb tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:39.408897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-093a6f5b-c448-40a4-b13f-5d92273378cb tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:39.409379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-093a6f5b-c448-40a4-b13f-5d92273378cb tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:39.409816 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-093a6f5b-c448-40a4-b13f-5d92273378cb tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:39.410515 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-093a6f5b-c448-40a4-b13f-5d92273378cb tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:39.411002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-093a6f5b-c448-40a4-b13f-5d92273378cb tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:39.411471 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-093a6f5b-c448-40a4-b13f-5d92273378cb tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:39.415464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:39.545478 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-093a6f5b-c448-40a4-b13f-5d92273378cb tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:39.553591 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-093a6f5b-c448-40a4-b13f-5d92273378cb tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1260 microversion: 2.1 time: 0.156682 Sep 08 14:06:39.554153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 432/860] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:39 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:39.876442 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:39.877046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:39.884078 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:39.884551 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:39.884979 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:39.887095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:39.887095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:39.887095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:40.021680 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:40.029944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:40.031426 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:40.032568 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f25ffa33-97f5-4ada-ad9a-4c0ac779987d tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.160318 Sep 08 14:06:40.033119 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 429/861] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:39 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:40.184797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:40.185286 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:40.192316 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:40.192968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:40.193409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:40.194151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:40.194577 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:40.195030 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:40.208500 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] HTTP exception thrown: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Request method failure captured: Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: DELETE /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e HTTP/1.1 Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVW0XblqzpKmD2u__hW2kio_fYuPre3cdiVNc1KOI02xERtcRS_DW5g-pUqNQxzC1Iaoj3qt_Px8yIWJBNdKjP5HdvYGhc_yB6dVQqSLuxkKWTvf56A5lJQpk9nVErxCKwceaG15aRC1IF6njBqK4-MhF2EKwi9O6hPNNch_WuBjr0 Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:06:40.210066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_4d0ed4e4f54c47369721e871f0dec518", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 7b403bdc9cad4783b72bbf174199363c Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:06:40.211620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': 'e6194e5e-54c1-4f8b-a021-be476c67c25e'} Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:06:40.213909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:06:40.215884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:06:40.217345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Returning 404 to user: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:06:40.217345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-692ddbb8-c5d8-4f91-8abb-9e281b85f9a1 tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 404 len: 111 microversion: 2.1 time: 0.031317 Sep 08 14:06:40.217345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 433/862] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:06:40 2022] DELETE /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:06:40.219847 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:40.220510 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] [instance: e6194e5e-54c1-4f8b-a021-be476c67c25e] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:40.226468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:40.226984 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:40.227418 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:40.228612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:40.229064 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:40.229487 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:40.242573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] HTTP exception thrown: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Request method failure captured: Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e HTTP/1.1 Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVW0XblqzpKmD2u__hW2kio_fYuPre3cdiVNc1KOI02xERtcRS_DW5g-pUqNQxzC1Iaoj3qt_Px8yIWJBNdKjP5HdvYGhc_yB6dVQqSLuxkKWTvf56A5lJQpk9nVErxCKwceaG15aRC1IF6njBqK4-MhF2EKwi9O6hPNNch_WuBjr0 Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:06:40.244830 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_4d0ed4e4f54c47369721e871f0dec518", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d0ed4e4f54c47369721e871f0dec518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 4d0ed4e4f54c47369721e871f0dec518 Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2015654077 Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 7b403bdc9cad4783b72bbf174199363c Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeTestJSON-2015654077-project Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:06:40.246358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'e6194e5e-54c1-4f8b-a021-be476c67c25e'} Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:06:40.250664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. Sep 08 14:06:40.252385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:06:40.253653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] Returning 404 to user: Instance e6194e5e-54c1-4f8b-a021-be476c67c25e could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:06:40.253653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ec7bf774-a0b1-4ae2-9298-29ecfd3d8ebb tempest-AttachVolumeTestJSON-2015654077 tempest-AttachVolumeTestJSON-2015654077-project] 10.222.0.91 "GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e" status: 404 len: 111 microversion: 2.1 time: 0.030160 Sep 08 14:06:40.253653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 430/863] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:40 2022] GET /compute/v2.1/servers/e6194e5e-54c1-4f8b-a021-be476c67c25e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:06:40.577197 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ad68c17c-e355-4e3e-9fd0-d04c158af439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:40.578183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ad68c17c-e355-4e3e-9fd0-d04c158af439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:40.584912 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad68c17c-e355-4e3e-9fd0-d04c158af439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:40.585424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad68c17c-e355-4e3e-9fd0-d04c158af439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:40.585850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad68c17c-e355-4e3e-9fd0-d04c158af439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:40.586550 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad68c17c-e355-4e3e-9fd0-d04c158af439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:40.587526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad68c17c-e355-4e3e-9fd0-d04c158af439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:40.587973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ad68c17c-e355-4e3e-9fd0-d04c158af439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:41.021434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ad68c17c-e355-4e3e-9fd0-d04c158af439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:41.031575 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ad68c17c-e355-4e3e-9fd0-d04c158af439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1260 microversion: 2.1 time: 0.458331 Sep 08 14:06:41.032156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 434/864] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:40 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1260 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:41.058739 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:41.060012 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:41.066086 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:41.066576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:41.067039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:41.067914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:41.068369 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:41.068793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:41.228563 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:41.236961 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:41.238397 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:41.239575 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-55619af0-cec1-48dd-b8a4-5c4b860ad06a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.185355 Sep 08 14:06:41.240120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 431/865] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:41 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:06:42.055069 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-16aa60b9-8142-4f3f-901d-77d4201e38ba tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:42.055675 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-16aa60b9-8142-4f3f-901d-77d4201e38ba tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:42.062009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16aa60b9-8142-4f3f-901d-77d4201e38ba tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.067477 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16aa60b9-8142-4f3f-901d-77d4201e38ba tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.067477 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16aa60b9-8142-4f3f-901d-77d4201e38ba tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.067477 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16aa60b9-8142-4f3f-901d-77d4201e38ba tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.067477 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16aa60b9-8142-4f3f-901d-77d4201e38ba tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.068381 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16aa60b9-8142-4f3f-901d-77d4201e38ba tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.266073 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:42.266820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:42.274161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.275599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.276108 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.276888 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.277507 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.277933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.304285 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-16aa60b9-8142-4f3f-901d-77d4201e38ba tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:42.314129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-16aa60b9-8142-4f3f-901d-77d4201e38ba tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1444 microversion: 2.1 time: 0.262946 Sep 08 14:06:42.316488 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 435/866] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:42 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1444 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:42.339286 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-cdb093d3-6ca3-47ad-a5bf-209aee525dc8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:42.340293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-cdb093d3-6ca3-47ad-a5bf-209aee525dc8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:42.346613 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cdb093d3-6ca3-47ad-a5bf-209aee525dc8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.347525 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cdb093d3-6ca3-47ad-a5bf-209aee525dc8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.348066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cdb093d3-6ca3-47ad-a5bf-209aee525dc8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.349276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cdb093d3-6ca3-47ad-a5bf-209aee525dc8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.349976 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cdb093d3-6ca3-47ad-a5bf-209aee525dc8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.350730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cdb093d3-6ca3-47ad-a5bf-209aee525dc8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.440942 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:42.447132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:42.449161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:42.450404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a0d68ed1-063e-410a-b302-8e42c11b7cc5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1744 microversion: 2.20 time: 0.188385 Sep 08 14:06:42.450987 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 432/867] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:42 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:42.564631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-cdb093d3-6ca3-47ad-a5bf-209aee525dc8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:42.574466 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-cdb093d3-6ca3-47ad-a5bf-209aee525dc8 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1444 microversion: 2.1 time: 0.239514 Sep 08 14:06:42.575467 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 436/868] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:42 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1444 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:43.483177 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:43.483795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:43.498866 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:43.499444 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:43.500056 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:43.500782 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:43.501230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:43.501835 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:44.075609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:44.085834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:44.090031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:44.093260 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f01d40bc-12c4-4e56-95b7-5232e62c0d55 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1744 microversion: 2.20 time: 0.619923 Sep 08 14:06:44.103207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 433/869] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:43 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1744 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:44.717117 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-2a7f752f-6069-4055-952c-6553e21b0fda req-f00366e2-3729-497a-a2dd-51b3bca4c725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94c00a6-d72c-4474-9ac0-8fedb2e32fe2", "name": "network-vif-plugged", "status": "completed", "tag": "d3992e28-2f02-43b3-9041-87bf6fafeffe"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:44.736946 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-2a7f752f-6069-4055-952c-6553e21b0fda req-f00366e2-3729-497a-a2dd-51b3bca4c725 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:44.738190 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-2a7f752f-6069-4055-952c-6553e21b0fda req-f00366e2-3729-497a-a2dd-51b3bca4c725 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:44.739009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-2a7f752f-6069-4055-952c-6553e21b0fda req-f00366e2-3729-497a-a2dd-51b3bca4c725 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:44.760782 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-2a7f752f-6069-4055-952c-6553e21b0fda req-f00366e2-3729-497a-a2dd-51b3bca4c725 service nova] Creating event network-vif-plugged:d3992e28-2f02-43b3-9041-87bf6fafeffe for instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 on hv-cinder-84773 Sep 08 14:06:44.769128 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-2a7f752f-6069-4055-952c-6553e21b0fda req-f00366e2-3729-497a-a2dd-51b3bca4c725 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059278 Sep 08 14:06:44.771433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 437/870] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:45.129229 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:45.129836 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:45.137838 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:45.138335 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:45.138772 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:45.139511 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:45.139961 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:45.140567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:45.343964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:45.357029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:45.358859 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:45.360339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ec8b2af7-cf8e-44ea-81cd-d28d2f267d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1744 microversion: 2.20 time: 0.236309 Sep 08 14:06:45.363808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 434/871] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:45 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1744 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:45.491466 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-68c3fa2e-3a88-4e89-bd6e-b17747c5c7b5 req-b51b04f5-db42-4ab0-8fa7-334c51369671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e11d590-d8c5-4b4a-ba5d-0a0ae203954b", "tag": "2bb33aac-6854-44c1-9bf8-4f4c73e872c4"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:45.507468 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-68c3fa2e-3a88-4e89-bd6e-b17747c5c7b5 req-b51b04f5-db42-4ab0-8fa7-334c51369671 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:45.507468 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-68c3fa2e-3a88-4e89-bd6e-b17747c5c7b5 req-b51b04f5-db42-4ab0-8fa7-334c51369671 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:45.507468 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-68c3fa2e-3a88-4e89-bd6e-b17747c5c7b5 req-b51b04f5-db42-4ab0-8fa7-334c51369671 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:45.514647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-68c3fa2e-3a88-4e89-bd6e-b17747c5c7b5 req-b51b04f5-db42-4ab0-8fa7-334c51369671 service nova] Creating event network-changed:2bb33aac-6854-44c1-9bf8-4f4c73e872c4 for instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b on hv-cinder-84773 Sep 08 14:06:45.519969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-68c3fa2e-3a88-4e89-bd6e-b17747c5c7b5 req-b51b04f5-db42-4ab0-8fa7-334c51369671 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035417 Sep 08 14:06:45.520657 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 438/872] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:46.389487 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:46.393751 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:46.405664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:46.406319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:46.406775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:46.408702 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:46.409436 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:46.410922 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:46.641682 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:46.653162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:46.654949 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:46.656493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-863a0465-aa18-491a-8c19-761aecf6b985 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.273557 Sep 08 14:06:46.657247 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 435/873] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:46 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:47.688223 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:47.688971 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:47.700482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:47.700974 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:47.701407 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:47.702113 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:47.702568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:47.703063 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:47.916576 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:47.927597 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:47.929273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:47.931564 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5dff5cee-9049-47ae-ba2c-c8ba2b0f3600 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.251121 Sep 08 14:06:47.932509 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 439/874] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:47 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:48.961366 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:48.963211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:48.970319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:48.970808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:48.972531 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:48.976315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:48.978456 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:48.978985 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:49.168200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:49.183643 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:49.186320 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:49.187765 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-50942cdf-bf8d-41fb-b94e-8662752d32d4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.230845 Sep 08 14:06:49.188315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 436/875] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:48 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:50.218118 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:50.218780 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:50.226275 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:50.226768 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:50.230349 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:50.230349 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:50.230349 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:50.230349 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:50.377247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:50.388297 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:50.390056 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:50.391412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1f7b5880-0c03-4699-a833-96a0b8c9aab7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.177408 Sep 08 14:06:50.392055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 440/876] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:50 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:51.420636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:51.421274 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:51.430955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:51.430955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:51.431469 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:51.432105 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:51.432586 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:51.433010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:51.647560 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:51.655025 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:51.657831 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:51.659632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e1da7b5d-d517-4b14-9ea1-dfa24fd1f48f tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.243115 Sep 08 14:06:51.671013 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 437/877] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:51 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:52.688199 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:52.689365 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:52.696906 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:52.697489 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:52.697998 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:52.698703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:52.699859 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:52.700487 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:52.853351 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:52.863213 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:52.864843 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:52.866433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c208b65d-7364-4b60-a1e7-7349210a1f95 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.183012 Sep 08 14:06:52.867646 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 441/878] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:52 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:53.894143 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:53.895094 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:53.902332 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:53.902860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:53.903402 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:53.904112 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:53.904562 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:53.905044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:54.044541 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:54.052926 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:54.054368 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:54.056058 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e4fbaa9e-c9ad-4b4d-8f7a-68d06cf74ee3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.165694 Sep 08 14:06:54.056612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 438/879] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:53 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:55.081526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:55.082994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:55.089996 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:55.090604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:55.091252 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:55.091946 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:55.092444 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:55.092934 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:55.282572 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:55.293330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:55.295092 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:55.296346 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d4ea0cc9-23bd-4844-a7d1-f3d3a210f0e3 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.218711 Sep 08 14:06:55.316430 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 442/880] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:55 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:56.325657 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:56.327247 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:56.334360 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:56.336922 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:56.337427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:56.338089 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:56.339023 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:56.339647 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:56.340240 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:56.579452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:56.593087 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:56.594976 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:56.596974 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-022b5394-c95c-408a-a423-a40d5b592b8a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.276127 Sep 08 14:06:56.603974 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 439/881] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:56 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:57.622627 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:57.623309 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:57.629934 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:57.630485 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:57.630821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:57.631547 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:57.631994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:57.632414 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:57.787464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:57.798182 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:57.799780 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:57.801055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9d9f17a9-969b-4ea1-b900-cbadfba38b79 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.182449 Sep 08 14:06:57.801636 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 443/882] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:57 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:58.833462 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:58.834069 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:58.841716 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:58.842221 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:58.842664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:58.844010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:58.844010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:58.844429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:59.001804 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:59.010232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:59.012518 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:59.012884 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b5298ce7-c313-413f-8c10-847bd3d4d844 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1739 microversion: 2.20 time: 0.188165 Sep 08 14:06:59.013433 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 440/883] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:06:58 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:06:59.841519 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-780cb835-bc9b-4fc9-b53f-ac48ba12532c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:59.842072 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-780cb835-bc9b-4fc9-b53f-ac48ba12532c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:59.844172 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=58 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:59.849004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-780cb835-bc9b-4fc9-b53f-ac48ba12532c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:59.849488 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-780cb835-bc9b-4fc9-b53f-ac48ba12532c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:59.849916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-780cb835-bc9b-4fc9-b53f-ac48ba12532c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:59.850616 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-780cb835-bc9b-4fc9-b53f-ac48ba12532c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:59.851094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-780cb835-bc9b-4fc9-b53f-ac48ba12532c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:59.851515 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-780cb835-bc9b-4fc9-b53f-ac48ba12532c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:59.877026 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-780cb835-bc9b-4fc9-b53f-ac48ba12532c tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/ips" status: 200 len: 149 microversion: 2.1 time: 0.041141 Sep 08 14:06:59.877656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 444/884] 10.222.0.91 () {58 vars in 1248 bytes} [Thu Sep 8 14:06:59 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:00.037760 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:00.038365 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:00.045451 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:00.045938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:00.046453 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:00.047245 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:00.047739 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:00.048172 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:00.180300 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:00.190766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:00.192706 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:00.195205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ec7c84aa-9220-479d-b376-ebf6b7d9d4e6 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1721 microversion: 2.20 time: 0.160716 Sep 08 14:07:00.195964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 441/885] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:00 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:01.223291 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:01.224180 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:01.231532 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:01.232009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:01.232437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:01.233134 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:01.233583 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:01.234458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:01.403722 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:01.412043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:01.413491 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:01.414656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e5a24d03-ff0e-4084-b73a-819436e7ef88 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1721 microversion: 2.20 time: 0.196497 Sep 08 14:07:01.415241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 445/886] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:01 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:01.604900 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-bd7e4243-1f0f-4818-88a8-5f8ca95cc2c8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d44ab32e-a7b0-41bc-af53-e2107ace03d5"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:01.607458 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-bd7e4243-1f0f-4818-88a8-5f8ca95cc2c8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:01.614372 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd7e4243-1f0f-4818-88a8-5f8ca95cc2c8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:01.614861 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd7e4243-1f0f-4818-88a8-5f8ca95cc2c8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:01.615325 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd7e4243-1f0f-4818-88a8-5f8ca95cc2c8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:01.616045 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd7e4243-1f0f-4818-88a8-5f8ca95cc2c8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:01.616501 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd7e4243-1f0f-4818-88a8-5f8ca95cc2c8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:01.616990 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bd7e4243-1f0f-4818-88a8-5f8ca95cc2c8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:02.443004 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:02.443598 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:02.450683 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:02.451187 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:02.451621 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:02.452330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:02.452822 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:02.453244 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:02.590046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:02.598424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:02.600067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:02.601241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-45abf900-1a97-4442-b192-0698b6e9aa29 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1721 microversion: 2.20 time: 0.162213 Sep 08 14:07:02.601807 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 446/887] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:02 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:07:02.791347 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-0a57da7a-5254-4efd-af72-50c581ea4cae req-a43f4bd4-0f68-45ef-a1d2-33d167f95e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94c00a6-d72c-4474-9ac0-8fedb2e32fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "d3992e28-2f02-43b3-9041-87bf6fafeffe"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:02.801285 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-0a57da7a-5254-4efd-af72-50c581ea4cae req-a43f4bd4-0f68-45ef-a1d2-33d167f95e6e service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:02.801761 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-0a57da7a-5254-4efd-af72-50c581ea4cae req-a43f4bd4-0f68-45ef-a1d2-33d167f95e6e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:02.802185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-0a57da7a-5254-4efd-af72-50c581ea4cae req-a43f4bd4-0f68-45ef-a1d2-33d167f95e6e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:02.814495 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-0a57da7a-5254-4efd-af72-50c581ea4cae req-a43f4bd4-0f68-45ef-a1d2-33d167f95e6e service nova] Creating event network-vif-unplugged:d3992e28-2f02-43b3-9041-87bf6fafeffe for instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 on hv-cinder-84773 Sep 08 14:07:02.819556 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-0a57da7a-5254-4efd-af72-50c581ea4cae req-a43f4bd4-0f68-45ef-a1d2-33d167f95e6e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033029 Sep 08 14:07:02.820124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 447/888] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:03.406452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-bd7e4243-1f0f-4818-88a8-5f8ca95cc2c8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "POST /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.806501 Sep 08 14:07:03.407199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 442/889] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:07:01 2022] POST /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments => generated 194 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:03.629251 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:03.629948 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:03.639603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:03.639603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:03.639603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:03.639603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:03.641703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:03.641703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:03.788231 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:03.797517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:03.799334 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:03.800628 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4aff9b54-ff17-4b86-ade7-735c3a706cec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1724 microversion: 2.20 time: 0.176339 Sep 08 14:07:03.801205 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 448/890] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:03 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:03.828661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-feaa36c9-61c7-4b4f-ba2f-ead990df9a1a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2fed463-e574-4129-88e7-5c8fec434c1c"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:03.831186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-feaa36c9-61c7-4b4f-ba2f-ead990df9a1a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:03.838361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feaa36c9-61c7-4b4f-ba2f-ead990df9a1a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:03.839014 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feaa36c9-61c7-4b4f-ba2f-ead990df9a1a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:03.839407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feaa36c9-61c7-4b4f-ba2f-ead990df9a1a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:03.840168 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feaa36c9-61c7-4b4f-ba2f-ead990df9a1a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:03.840625 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feaa36c9-61c7-4b4f-ba2f-ead990df9a1a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:03.841207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-feaa36c9-61c7-4b4f-ba2f-ead990df9a1a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:04.539664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:05.218294 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-feaa36c9-61c7-4b4f-ba2f-ead990df9a1a tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "POST /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.394603 Sep 08 14:07:05.218935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 443/891] 10.222.0.91 () {62 vars in 1364 bytes} [Thu Sep 8 14:07:03 2022] POST /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/os-volume_attachments => generated 188 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:07:05.347041 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a540a49c-3700-40b5-8211-ca7be165fddb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:05.347558 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a540a49c-3700-40b5-8211-ca7be165fddb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:05.354054 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a540a49c-3700-40b5-8211-ca7be165fddb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:05.355804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a540a49c-3700-40b5-8211-ca7be165fddb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:05.355804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a540a49c-3700-40b5-8211-ca7be165fddb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:05.355804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a540a49c-3700-40b5-8211-ca7be165fddb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:05.356087 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a540a49c-3700-40b5-8211-ca7be165fddb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:05.356494 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a540a49c-3700-40b5-8211-ca7be165fddb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:06.004248 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:06.133070 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a540a49c-3700-40b5-8211-ca7be165fddb tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/os-volume_attachments/e2fed463-e574-4129-88e7-5c8fec434c1c" status: 202 len: 0 microversion: 2.20 time: 0.789660 Sep 08 14:07:06.133242 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 449/892] 10.222.0.91 () {60 vars in 1457 bytes} [Thu Sep 8 14:07:05 2022] DELETE /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/os-volume_attachments/e2fed463-e574-4129-88e7-5c8fec434c1c => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:07:06.198701 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a1de9ac2-07e4-48cb-9526-aa0686e51e27 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:06.199358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a1de9ac2-07e4-48cb-9526-aa0686e51e27 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:06.206467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a1de9ac2-07e4-48cb-9526-aa0686e51e27 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:06.206982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a1de9ac2-07e4-48cb-9526-aa0686e51e27 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:06.207487 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a1de9ac2-07e4-48cb-9526-aa0686e51e27 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:06.208183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a1de9ac2-07e4-48cb-9526-aa0686e51e27 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:06.208633 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a1de9ac2-07e4-48cb-9526-aa0686e51e27 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:06.209053 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a1de9ac2-07e4-48cb-9526-aa0686e51e27 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:06.253925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a1de9ac2-07e4-48cb-9526-aa0686e51e27 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133058) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 14:07:06.653175 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a1de9ac2-07e4-48cb-9526-aa0686e51e27 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "POST /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/action" status: 202 len: 0 microversion: 2.20 time: 0.458925 Sep 08 14:07:06.653878 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 444/893] 10.222.0.91 () {62 vars in 1319 bytes} [Thu Sep 8 14:07:06 2022] POST /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:07:06.662468 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:06.663428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:06.671780 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:06.672537 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:06.673040 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:06.673761 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:06.674214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:06.674639 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:06.886734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:06.895369 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:06.896839 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:06.897991 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c040a3e1-30f7-4746-9f47-20f0725d4fec tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1672 microversion: 2.20 time: 0.239437 Sep 08 14:07:06.899020 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 450/894] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:06 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1672 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:07.924871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:07.925534 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:07.931544 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:07.932058 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:07.932481 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:07.933175 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:07.933620 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:07.934036 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:08.077271 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:08.087238 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:08.088784 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:08.091517 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-34d35368-b092-4ee0-ba90-c2d859260134 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1672 microversion: 2.20 time: 0.170095 Sep 08 14:07:08.091517 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 445/895] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:07 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:09.116058 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:09.117245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:09.124049 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:09.124569 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:09.125000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:09.125692 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:09.126142 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:09.126554 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:09.338719 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:09.347360 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:09.348794 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:09.349947 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-109bc921-c145-4a58-97a4-fca241fbc55b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.237868 Sep 08 14:07:09.350516 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 451/896] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:09 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:09.728011 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-924656538", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "networks": [{"uuid": "8a6b9b27-99be-4a97-bac8-eb6cb1a0fd4d"}]}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:09.782494 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] validate_networks() for [('8a6b9b27-99be-4a97-bac8-eb6cb1a0fd4d', None, None, None, None, None)] {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:07:10.164588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:07:10.165660 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:07:10.167332 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:07:10.167904 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:07:10.168587 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:07:10.178548 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:10.179076 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:10.179603 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:10.180493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:10.180982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:10.181440 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:10.199189 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Getting quotas for project fefb0f83ce4447cc9223c383a256676a. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:07:10.203554 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Getting quotas for user b4cc11524fe542c5a5361b3630e6d3a6 and project fefb0f83ce4447cc9223c383a256676a. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:07:10.215374 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:07:10.217592 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:07:10.376199 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:10.377476 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:10.384562 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:10.385053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:10.387082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:10.387082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:10.387082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:10.387082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:10.399214 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ddd732d4-c585-414f-8dfe-b0265a29e888 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674542 Sep 08 14:07:10.406513 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 446/897] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:07:10.413065 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3b883eec-ac6e-40cb-98a6-3c2e921d0aab tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:10.413933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3b883eec-ac6e-40cb-98a6-3c2e921d0aab tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:10.547990 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3b883eec-ac6e-40cb-98a6-3c2e921d0aab tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:10.562876 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3b883eec-ac6e-40cb-98a6-3c2e921d0aab tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1213 microversion: 2.1 time: 0.154255 Sep 08 14:07:10.563877 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 447/898] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:10 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:10.591192 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:10.602853 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:10.605263 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:10.606574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2170da8b-f258-4dd1-a69d-6c2b3f9d0265 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.234510 Sep 08 14:07:10.607254 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 452/899] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:10 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:11.586572 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4a0c3c58-9d29-427f-bf5d-2771b55bd375 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:11.587829 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4a0c3c58-9d29-427f-bf5d-2771b55bd375 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:11.645592 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:11.646313 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:11.656758 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:11.657545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:11.658225 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:11.659156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:11.659764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:11.660380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:11.666945 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4a0c3c58-9d29-427f-bf5d-2771b55bd375 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:11.678113 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4a0c3c58-9d29-427f-bf5d-2771b55bd375 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1213 microversion: 2.1 time: 0.095554 Sep 08 14:07:11.679737 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 448/900] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:11 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:11.818009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:11.834183 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:11.835669 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:11.837145 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3eb806a6-f4a1-4e2e-883a-2a2c476aac1b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.196748 Sep 08 14:07:11.837897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 453/901] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:11 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:07:12.703409 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d5ae8111-f95f-4fa5-bcb1-adbcca958f29 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:12.705140 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d5ae8111-f95f-4fa5-bcb1-adbcca958f29 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:12.712425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5ae8111-f95f-4fa5-bcb1-adbcca958f29 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:12.713425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5ae8111-f95f-4fa5-bcb1-adbcca958f29 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:12.713856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5ae8111-f95f-4fa5-bcb1-adbcca958f29 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:12.714542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5ae8111-f95f-4fa5-bcb1-adbcca958f29 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:12.715009 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5ae8111-f95f-4fa5-bcb1-adbcca958f29 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:12.715430 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d5ae8111-f95f-4fa5-bcb1-adbcca958f29 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:12.778567 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d5ae8111-f95f-4fa5-bcb1-adbcca958f29 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:12.786844 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d5ae8111-f95f-4fa5-bcb1-adbcca958f29 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.087842 Sep 08 14:07:12.787467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 449/902] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:12 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:12.866431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:12.868231 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:12.875926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:12.876582 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:12.877269 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:12.878055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:12.879503 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:12.880008 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:13.038609 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:13.047605 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:13.049399 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:13.050626 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1e93052b-d6bc-4044-9b52-d6a32a07af8b tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.189386 Sep 08 14:07:13.051358 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 454/903] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:12 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:13.812422 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-852821df-d1df-4009-bd76-fa6dc0610ef0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:13.813092 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-852821df-d1df-4009-bd76-fa6dc0610ef0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:13.820019 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-852821df-d1df-4009-bd76-fa6dc0610ef0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:13.820566 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-852821df-d1df-4009-bd76-fa6dc0610ef0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:13.821056 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-852821df-d1df-4009-bd76-fa6dc0610ef0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:13.821762 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-852821df-d1df-4009-bd76-fa6dc0610ef0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:13.822427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-852821df-d1df-4009-bd76-fa6dc0610ef0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:13.823044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-852821df-d1df-4009-bd76-fa6dc0610ef0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:13.892992 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-852821df-d1df-4009-bd76-fa6dc0610ef0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:13.901775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-852821df-d1df-4009-bd76-fa6dc0610ef0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.094719 Sep 08 14:07:13.908642 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 450/904] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:13 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:14.076272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:14.076826 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:14.083584 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.084115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.084543 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:14.085251 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.085703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.086130 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:14.237662 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:14.247171 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:14.249389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:14.251170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ec04cffe-ff41-489b-bde9-be84125ef3b2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.178509 Sep 08 14:07:14.251731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 455/905] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:14 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:14.925016 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1013949c-4f8a-4492-8925-43e892333004 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:14.925759 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1013949c-4f8a-4492-8925-43e892333004 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:14.933979 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1013949c-4f8a-4492-8925-43e892333004 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.934913 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1013949c-4f8a-4492-8925-43e892333004 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.935363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1013949c-4f8a-4492-8925-43e892333004 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:14.936070 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1013949c-4f8a-4492-8925-43e892333004 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.937094 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1013949c-4f8a-4492-8925-43e892333004 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.937682 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1013949c-4f8a-4492-8925-43e892333004 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:15.007544 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1013949c-4f8a-4492-8925-43e892333004 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:15.016711 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1013949c-4f8a-4492-8925-43e892333004 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.096320 Sep 08 14:07:15.017287 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 451/906] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:14 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:15.286472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:15.287115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:15.295367 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:15.296271 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:15.296862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:15.297748 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:15.298356 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:15.298957 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:15.468219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:15.476877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:15.479201 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:15.480604 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-79f55787-362a-4f2c-9a56-b117659cbe52 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.202466 Sep 08 14:07:15.492178 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 456/907] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:15 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:16.041615 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2f7c5772-6faf-4a6d-8022-000f15483a22 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:16.042484 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2f7c5772-6faf-4a6d-8022-000f15483a22 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:16.050279 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2f7c5772-6faf-4a6d-8022-000f15483a22 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.051101 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2f7c5772-6faf-4a6d-8022-000f15483a22 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.051719 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2f7c5772-6faf-4a6d-8022-000f15483a22 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.052677 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2f7c5772-6faf-4a6d-8022-000f15483a22 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.053138 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2f7c5772-6faf-4a6d-8022-000f15483a22 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.053569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2f7c5772-6faf-4a6d-8022-000f15483a22 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.123356 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2f7c5772-6faf-4a6d-8022-000f15483a22 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:16.137373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2f7c5772-6faf-4a6d-8022-000f15483a22 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.099853 Sep 08 14:07:16.151496 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 452/908] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:16 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:16.507530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:16.508310 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:16.515986 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.516739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.517174 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.518068 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.518518 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.518967 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.662955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:16.672184 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:16.673612 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:16.674807 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-60f97d4d-0599-4d27-bb34-eb6db1d504d7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.171726 Sep 08 14:07:16.675390 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 457/909] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:16 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:17.162456 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-338544a3-41d9-4136-9b52-e9434adff4af tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:17.163629 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-338544a3-41d9-4136-9b52-e9434adff4af tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:17.171229 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-338544a3-41d9-4136-9b52-e9434adff4af tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:17.172177 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-338544a3-41d9-4136-9b52-e9434adff4af tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:17.172856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-338544a3-41d9-4136-9b52-e9434adff4af tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:17.173503 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-338544a3-41d9-4136-9b52-e9434adff4af tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:17.174452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-338544a3-41d9-4136-9b52-e9434adff4af tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:17.174912 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-338544a3-41d9-4136-9b52-e9434adff4af tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:17.281466 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-338544a3-41d9-4136-9b52-e9434adff4af tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:17.291728 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-338544a3-41d9-4136-9b52-e9434adff4af tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.133300 Sep 08 14:07:17.293433 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 453/910] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:17 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:17.702788 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:17.703519 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:17.710722 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:17.711721 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:17.712348 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:17.713061 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:17.713522 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:17.714132 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:17.871050 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:17.880674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:17.882332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:17.883749 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e6e7eab9-16de-44cd-8ded-4b0e060c8c32 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.185411 Sep 08 14:07:17.884312 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 458/911] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:17 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:18.317365 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a95b7758-648c-4cfd-8fb4-fe0fd46e288b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:18.317917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a95b7758-648c-4cfd-8fb4-fe0fd46e288b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:18.325936 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a95b7758-648c-4cfd-8fb4-fe0fd46e288b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.326402 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a95b7758-648c-4cfd-8fb4-fe0fd46e288b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.327555 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a95b7758-648c-4cfd-8fb4-fe0fd46e288b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.327555 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a95b7758-648c-4cfd-8fb4-fe0fd46e288b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.331483 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a95b7758-648c-4cfd-8fb4-fe0fd46e288b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.331483 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a95b7758-648c-4cfd-8fb4-fe0fd46e288b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.398285 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a95b7758-648c-4cfd-8fb4-fe0fd46e288b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:18.407698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a95b7758-648c-4cfd-8fb4-fe0fd46e288b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.094267 Sep 08 14:07:18.408343 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 454/912] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:18 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:18.911205 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:18.911954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:18.920156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.920644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.921073 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.921769 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.922217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.922634 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:19.060754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:19.069644 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:19.071148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:19.072364 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-040606ef-d8a7-4bd3-b5bd-028659960f08 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.165342 Sep 08 14:07:19.072940 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 459/913] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:18 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:19.429700 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8775c6e5-a427-4ecd-8464-81e0c36d2849 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:19.430318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8775c6e5-a427-4ecd-8464-81e0c36d2849 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:19.437045 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8775c6e5-a427-4ecd-8464-81e0c36d2849 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:19.437521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8775c6e5-a427-4ecd-8464-81e0c36d2849 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:19.437953 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8775c6e5-a427-4ecd-8464-81e0c36d2849 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:19.438632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8775c6e5-a427-4ecd-8464-81e0c36d2849 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:19.439185 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8775c6e5-a427-4ecd-8464-81e0c36d2849 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:19.439601 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8775c6e5-a427-4ecd-8464-81e0c36d2849 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:19.501047 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8775c6e5-a427-4ecd-8464-81e0c36d2849 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:19.508708 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8775c6e5-a427-4ecd-8464-81e0c36d2849 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.082947 Sep 08 14:07:19.509265 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 455/914] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:19 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:20.097803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:20.098412 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:20.104950 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:20.105436 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:20.105874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:20.106582 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:20.107068 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:20.107520 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:20.253362 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:20.262199 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:20.263732 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:20.265124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8b881db2-90c6-4b96-9b37-c30fc0e83aba tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.171422 Sep 08 14:07:20.265676 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 460/915] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:20 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:20.531590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7ce8baa0-f968-4947-aff9-3e9c2ff225e2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:20.532199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7ce8baa0-f968-4947-aff9-3e9c2ff225e2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:20.534059 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:20.539351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ce8baa0-f968-4947-aff9-3e9c2ff225e2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:20.545646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ce8baa0-f968-4947-aff9-3e9c2ff225e2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:20.545646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ce8baa0-f968-4947-aff9-3e9c2ff225e2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:20.545646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ce8baa0-f968-4947-aff9-3e9c2ff225e2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:20.545646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ce8baa0-f968-4947-aff9-3e9c2ff225e2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:20.546016 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7ce8baa0-f968-4947-aff9-3e9c2ff225e2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:20.609241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7ce8baa0-f968-4947-aff9-3e9c2ff225e2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:20.615263 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7ce8baa0-f968-4947-aff9-3e9c2ff225e2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.087456 Sep 08 14:07:20.615843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 456/916] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:20 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:21.290983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:21.291523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:21.297902 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:21.298377 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:21.298809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:21.299528 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:21.299980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:21.300411 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:21.438599 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:21.449497 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:21.450983 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:21.452233 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e9ea7697-cdbd-432e-b623-4d4a934011d5 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.165306 Sep 08 14:07:21.452788 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 461/917] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:21 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:21.639832 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-48e9901f-c5e5-4bca-9e0b-aef8868a50d4 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:21.641447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-48e9901f-c5e5-4bca-9e0b-aef8868a50d4 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:21.648873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48e9901f-c5e5-4bca-9e0b-aef8868a50d4 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:21.649393 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48e9901f-c5e5-4bca-9e0b-aef8868a50d4 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:21.649924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48e9901f-c5e5-4bca-9e0b-aef8868a50d4 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:21.650579 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48e9901f-c5e5-4bca-9e0b-aef8868a50d4 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:21.651065 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48e9901f-c5e5-4bca-9e0b-aef8868a50d4 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:21.651573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48e9901f-c5e5-4bca-9e0b-aef8868a50d4 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:21.674278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=10 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:21.718604 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-48e9901f-c5e5-4bca-9e0b-aef8868a50d4 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:21.726931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-48e9901f-c5e5-4bca-9e0b-aef8868a50d4 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.091687 Sep 08 14:07:21.727608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 457/918] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:21 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:22.480055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:22.480685 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:22.487432 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:22.487919 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:22.488605 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:22.489053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:22.489510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:22.489935 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:22.623222 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:22.631543 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:22.633022 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:22.634130 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f904e444-8aaf-41ad-8211-d384f7e10747 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.159587 Sep 08 14:07:22.634685 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 462/919] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:22 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:22.750199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-74359d7c-2416-40a7-9135-c23ff4f023df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:22.750736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-74359d7c-2416-40a7-9135-c23ff4f023df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:22.757803 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74359d7c-2416-40a7-9135-c23ff4f023df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:22.758286 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74359d7c-2416-40a7-9135-c23ff4f023df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:22.758723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74359d7c-2416-40a7-9135-c23ff4f023df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:22.759439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74359d7c-2416-40a7-9135-c23ff4f023df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:22.760423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74359d7c-2416-40a7-9135-c23ff4f023df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:22.760843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-74359d7c-2416-40a7-9135-c23ff4f023df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:22.824893 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-74359d7c-2416-40a7-9135-c23ff4f023df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:22.832920 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-74359d7c-2416-40a7-9135-c23ff4f023df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.086826 Sep 08 14:07:22.833623 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 458/920] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:22 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:23.001010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-44d82ad3-7196-4405-ab7e-a3ade9f22c50 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:23.001524 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-44d82ad3-7196-4405-ab7e-a3ade9f22c50 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:23.007671 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-44d82ad3-7196-4405-ab7e-a3ade9f22c50 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:23.008158 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-44d82ad3-7196-4405-ab7e-a3ade9f22c50 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:23.008595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-44d82ad3-7196-4405-ab7e-a3ade9f22c50 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:23.009290 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-44d82ad3-7196-4405-ab7e-a3ade9f22c50 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:23.010288 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-44d82ad3-7196-4405-ab7e-a3ade9f22c50 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:23.010714 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-44d82ad3-7196-4405-ab7e-a3ade9f22c50 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:23.090220 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-44d82ad3-7196-4405-ab7e-a3ade9f22c50 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lazy-loading 'services' on Instance uuid 53e8a357-9c5c-41db-8440-b5ebe04b6c8c {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:23.310261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-44d82ad3-7196-4405-ab7e-a3ade9f22c50 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments/d44ab32e-a7b0-41bc-af53-e2107ace03d5" status: 202 len: 0 microversion: 2.1 time: 0.313058 Sep 08 14:07:23.310750 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 463/921] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:07:22 2022] DELETE /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments/d44ab32e-a7b0-41bc-af53-e2107ace03d5 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:07:23.319321 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8a6f9138-22f5-403f-9f76-6fbfddc771b0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:23.321607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8a6f9138-22f5-403f-9f76-6fbfddc771b0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:23.328286 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a6f9138-22f5-403f-9f76-6fbfddc771b0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:23.328765 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a6f9138-22f5-403f-9f76-6fbfddc771b0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:23.329197 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a6f9138-22f5-403f-9f76-6fbfddc771b0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:23.329879 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a6f9138-22f5-403f-9f76-6fbfddc771b0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:23.330330 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a6f9138-22f5-403f-9f76-6fbfddc771b0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:23.330751 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8a6f9138-22f5-403f-9f76-6fbfddc771b0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:23.360405 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8a6f9138-22f5-403f-9f76-6fbfddc771b0 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Sep 08 14:07:23.360970 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 459/922] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:23 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:23.661718 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:23.662411 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:23.669094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:23.669570 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:23.669994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:23.670717 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:23.671156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:23.671571 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:23.804520 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:23.813249 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:23.814684 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:23.815928 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-59664af1-aaeb-47c2-959b-a4bceb143e26 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.159247 Sep 08 14:07:23.816549 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 464/923] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:23 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:23.856662 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2c416dc7-adeb-4872-880b-a27ce5f87e8d tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:23.857452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2c416dc7-adeb-4872-880b-a27ce5f87e8d tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:23.864236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2c416dc7-adeb-4872-880b-a27ce5f87e8d tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:23.864735 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2c416dc7-adeb-4872-880b-a27ce5f87e8d tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:23.865188 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2c416dc7-adeb-4872-880b-a27ce5f87e8d tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:23.866028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2c416dc7-adeb-4872-880b-a27ce5f87e8d tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:23.866480 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2c416dc7-adeb-4872-880b-a27ce5f87e8d tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:23.866919 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2c416dc7-adeb-4872-880b-a27ce5f87e8d tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:23.871270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:23.972661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2c416dc7-adeb-4872-880b-a27ce5f87e8d tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:23.972661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2c416dc7-adeb-4872-880b-a27ce5f87e8d tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.088452 Sep 08 14:07:23.972661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 460/924] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:23 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:24.373146 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9aadcb0e-846b-4ea6-956a-ab3417b0110d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:24.375944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9aadcb0e-846b-4ea6-956a-ab3417b0110d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:24.382450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aadcb0e-846b-4ea6-956a-ab3417b0110d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:24.382956 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aadcb0e-846b-4ea6-956a-ab3417b0110d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:24.383389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aadcb0e-846b-4ea6-956a-ab3417b0110d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:24.384074 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aadcb0e-846b-4ea6-956a-ab3417b0110d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:24.385031 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aadcb0e-846b-4ea6-956a-ab3417b0110d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:24.385469 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aadcb0e-846b-4ea6-956a-ab3417b0110d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:24.399987 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:24.417321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9aadcb0e-846b-4ea6-956a-ab3417b0110d tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048369 Sep 08 14:07:24.417884 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 465/925] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:24 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:24.842022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:24.842568 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:24.848852 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:24.849349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:24.849777 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:24.850451 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:24.850914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:24.851333 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:24.962628 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-98fe126a-0ce7-4683-8010-52ab23e64895 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:24.963290 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-98fe126a-0ce7-4683-8010-52ab23e64895 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:24.969621 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98fe126a-0ce7-4683-8010-52ab23e64895 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:24.970099 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98fe126a-0ce7-4683-8010-52ab23e64895 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:24.970527 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98fe126a-0ce7-4683-8010-52ab23e64895 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:24.971246 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98fe126a-0ce7-4683-8010-52ab23e64895 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:24.971695 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98fe126a-0ce7-4683-8010-52ab23e64895 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:24.972112 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-98fe126a-0ce7-4683-8010-52ab23e64895 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:25.002647 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:25.011624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:25.013095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:25.014263 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-293f1410-0272-403e-8671-2c8ff932e9ee tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.176702 Sep 08 14:07:25.014846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 461/926] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:24 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:25.035826 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-98fe126a-0ce7-4683-8010-52ab23e64895 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:25.045372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-98fe126a-0ce7-4683-8010-52ab23e64895 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1217 microversion: 2.1 time: 0.085449 Sep 08 14:07:25.045372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 466/927] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:24 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:25.437112 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a59492d3-8300-4b2e-9f62-8ef2f7014403 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:25.441411 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a59492d3-8300-4b2e-9f62-8ef2f7014403 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:25.448875 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a59492d3-8300-4b2e-9f62-8ef2f7014403 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:25.449407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a59492d3-8300-4b2e-9f62-8ef2f7014403 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:25.449905 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a59492d3-8300-4b2e-9f62-8ef2f7014403 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:25.450708 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a59492d3-8300-4b2e-9f62-8ef2f7014403 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:25.451257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a59492d3-8300-4b2e-9f62-8ef2f7014403 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:25.451739 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a59492d3-8300-4b2e-9f62-8ef2f7014403 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:25.489964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a59492d3-8300-4b2e-9f62-8ef2f7014403 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061760 Sep 08 14:07:25.491135 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 462/928] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:25 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:26.046242 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:26.046852 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:26.054955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:26.055440 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:26.055867 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:26.057090 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:26.057542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:26.057973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:26.067436 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5e944cb1-6758-447a-ae34-ae266ac80faf tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:26.069260 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5e944cb1-6758-447a-ae34-ae266ac80faf tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:26.077314 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e944cb1-6758-447a-ae34-ae266ac80faf tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:26.077812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e944cb1-6758-447a-ae34-ae266ac80faf tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:26.078571 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e944cb1-6758-447a-ae34-ae266ac80faf tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:26.079339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e944cb1-6758-447a-ae34-ae266ac80faf tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:26.079798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e944cb1-6758-447a-ae34-ae266ac80faf tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:26.080682 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5e944cb1-6758-447a-ae34-ae266ac80faf tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:26.152374 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5e944cb1-6758-447a-ae34-ae266ac80faf tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:26.185489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5e944cb1-6758-447a-ae34-ae266ac80faf tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1209 microversion: 2.1 time: 0.121853 Sep 08 14:07:26.186080 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 463/929] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:26 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:26.227624 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:26.238430 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:26.238430 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:26.239029 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-222ddbe2-2781-4cef-960d-31d5b4bdbd80 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.197164 Sep 08 14:07:26.239596 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 467/930] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:26 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:26.502999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8bcc5efe-1b17-4cb5-a1d3-5e380a4ccac1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:26.505146 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8bcc5efe-1b17-4cb5-a1d3-5e380a4ccac1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:26.511285 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bcc5efe-1b17-4cb5-a1d3-5e380a4ccac1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:26.511777 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bcc5efe-1b17-4cb5-a1d3-5e380a4ccac1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:26.512218 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bcc5efe-1b17-4cb5-a1d3-5e380a4ccac1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:26.512924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bcc5efe-1b17-4cb5-a1d3-5e380a4ccac1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:26.513433 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bcc5efe-1b17-4cb5-a1d3-5e380a4ccac1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:26.513858 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8bcc5efe-1b17-4cb5-a1d3-5e380a4ccac1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:26.544775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8bcc5efe-1b17-4cb5-a1d3-5e380a4ccac1 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045875 Sep 08 14:07:26.545390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 464/931] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:26 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:27.210045 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-77064178-a5fc-46e2-8c25-e6430a3ad3ff tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:27.211129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-77064178-a5fc-46e2-8c25-e6430a3ad3ff tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:27.220721 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77064178-a5fc-46e2-8c25-e6430a3ad3ff tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.221377 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77064178-a5fc-46e2-8c25-e6430a3ad3ff tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.221812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77064178-a5fc-46e2-8c25-e6430a3ad3ff tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.222505 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77064178-a5fc-46e2-8c25-e6430a3ad3ff tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.222978 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77064178-a5fc-46e2-8c25-e6430a3ad3ff tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.223588 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-77064178-a5fc-46e2-8c25-e6430a3ad3ff tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.270044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:27.270044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:27.275229 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.276342 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.276795 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.277498 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.277954 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.278524 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.302988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-77064178-a5fc-46e2-8c25-e6430a3ad3ff tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:27.319488 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-77064178-a5fc-46e2-8c25-e6430a3ad3ff tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1273 microversion: 2.1 time: 0.107951 Sep 08 14:07:27.320154 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 468/932] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:27 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:27.455886 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:27.480902 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:27.480902 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:27.480902 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f0761b2c-8de6-4a6d-bd71-47f831dbb29c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.215712 Sep 08 14:07:27.481287 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 465/933] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:27 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:07:27.559451 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3aabaa69-cc30-455e-85af-243fd884d386 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:27.562210 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3aabaa69-cc30-455e-85af-243fd884d386 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:27.568230 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aabaa69-cc30-455e-85af-243fd884d386 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.568812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aabaa69-cc30-455e-85af-243fd884d386 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.569313 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aabaa69-cc30-455e-85af-243fd884d386 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.570111 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aabaa69-cc30-455e-85af-243fd884d386 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.570628 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aabaa69-cc30-455e-85af-243fd884d386 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.571254 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3aabaa69-cc30-455e-85af-243fd884d386 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.604634 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3aabaa69-cc30-455e-85af-243fd884d386 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050720 Sep 08 14:07:27.605525 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 469/934] 10.222.0.91 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:27 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:07:27.679607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0012b57b-e555-4d6b-92fd-022b49b0ed51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:27.680246 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0012b57b-e555-4d6b-92fd-022b49b0ed51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:27.687308 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0012b57b-e555-4d6b-92fd-022b49b0ed51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.688601 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0012b57b-e555-4d6b-92fd-022b49b0ed51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.688601 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0012b57b-e555-4d6b-92fd-022b49b0ed51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.688991 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0012b57b-e555-4d6b-92fd-022b49b0ed51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.689443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0012b57b-e555-4d6b-92fd-022b49b0ed51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.689868 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0012b57b-e555-4d6b-92fd-022b49b0ed51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.716238 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0012b57b-e555-4d6b-92fd-022b49b0ed51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:07:28.044465 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0012b57b-e555-4d6b-92fd-022b49b0ed51 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 204 len: 0 microversion: 2.1 time: 0.368647 Sep 08 14:07:28.045043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 466/935] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:27 2022] DELETE /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:07:28.053300 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d8b4e62e-0cb1-4f79-9914-b6cf0d032ac8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:28.054035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d8b4e62e-0cb1-4f79-9914-b6cf0d032ac8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:28.060322 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8b4e62e-0cb1-4f79-9914-b6cf0d032ac8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.060803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8b4e62e-0cb1-4f79-9914-b6cf0d032ac8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.061229 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8b4e62e-0cb1-4f79-9914-b6cf0d032ac8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.061955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8b4e62e-0cb1-4f79-9914-b6cf0d032ac8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.062387 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8b4e62e-0cb1-4f79-9914-b6cf0d032ac8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.062800 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d8b4e62e-0cb1-4f79-9914-b6cf0d032ac8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.205051 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d8b4e62e-0cb1-4f79-9914-b6cf0d032ac8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:28.211385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d8b4e62e-0cb1-4f79-9914-b6cf0d032ac8 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1682 microversion: 2.1 time: 0.161793 Sep 08 14:07:28.211972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 470/936] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:28 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:28.347831 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a6816774-b6fd-40c4-9582-35718eed1665 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:28.348576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a6816774-b6fd-40c4-9582-35718eed1665 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:28.356134 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a6816774-b6fd-40c4-9582-35718eed1665 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.356627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a6816774-b6fd-40c4-9582-35718eed1665 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.357093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a6816774-b6fd-40c4-9582-35718eed1665 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.357793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a6816774-b6fd-40c4-9582-35718eed1665 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.358241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a6816774-b6fd-40c4-9582-35718eed1665 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.358656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a6816774-b6fd-40c4-9582-35718eed1665 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.499822 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a6816774-b6fd-40c4-9582-35718eed1665 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:28.507299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:28.507299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:28.507556 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a6816774-b6fd-40c4-9582-35718eed1665 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.163493 Sep 08 14:07:28.507763 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 467/937] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:28 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:28.512969 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.513484 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.513914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.514708 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.515185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.515609 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.653042 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:28.661362 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:28.663135 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:28.663971 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9a4a6309-3783-475a-b19a-223d9cf39ab0 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.161923 Sep 08 14:07:28.664523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 471/938] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:28 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:29.006589 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-8851ab56-c29c-4bbc-9a2a-80d6c867cac4 req-9d0e6b11-0d64-462a-992b-6ebc068ccdaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94c00a6-d72c-4474-9ac0-8fedb2e32fe2", "name": "network-vif-plugged", "status": "completed", "tag": "d3992e28-2f02-43b3-9041-87bf6fafeffe"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:29.014081 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:29.018494 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-8851ab56-c29c-4bbc-9a2a-80d6c867cac4 req-9d0e6b11-0d64-462a-992b-6ebc068ccdaa service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.019281 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-8851ab56-c29c-4bbc-9a2a-80d6c867cac4 req-9d0e6b11-0d64-462a-992b-6ebc068ccdaa service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.019722 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-8851ab56-c29c-4bbc-9a2a-80d6c867cac4 req-9d0e6b11-0d64-462a-992b-6ebc068ccdaa service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.038623 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-8851ab56-c29c-4bbc-9a2a-80d6c867cac4 req-9d0e6b11-0d64-462a-992b-6ebc068ccdaa service nova] Creating event network-vif-plugged:d3992e28-2f02-43b3-9041-87bf6fafeffe for instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 on hv-cinder-84773 Sep 08 14:07:29.045233 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-8851ab56-c29c-4bbc-9a2a-80d6c867cac4 req-9d0e6b11-0d64-462a-992b-6ebc068ccdaa service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042574 Sep 08 14:07:29.045933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 468/939] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:29.236732 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f4b256d2-4474-4479-88cc-476ae4a23e02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:29.237353 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f4b256d2-4474-4479-88cc-476ae4a23e02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:29.244464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f4b256d2-4474-4479-88cc-476ae4a23e02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.244963 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f4b256d2-4474-4479-88cc-476ae4a23e02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.245398 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f4b256d2-4474-4479-88cc-476ae4a23e02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.246107 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f4b256d2-4474-4479-88cc-476ae4a23e02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.246588 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f4b256d2-4474-4479-88cc-476ae4a23e02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.247007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f4b256d2-4474-4479-88cc-476ae4a23e02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.397811 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f4b256d2-4474-4479-88cc-476ae4a23e02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:29.406037 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f4b256d2-4474-4479-88cc-476ae4a23e02 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1682 microversion: 2.1 time: 0.173565 Sep 08 14:07:29.406978 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 472/940] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:29 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:29.538856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-bb689a82-5036-40b1-b653-355af49c49df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:29.539785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-bb689a82-5036-40b1-b653-355af49c49df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:29.547322 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb689a82-5036-40b1-b653-355af49c49df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.547886 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb689a82-5036-40b1-b653-355af49c49df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.548533 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb689a82-5036-40b1-b653-355af49c49df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.549238 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb689a82-5036-40b1-b653-355af49c49df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.555232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb689a82-5036-40b1-b653-355af49c49df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.555232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-bb689a82-5036-40b1-b653-355af49c49df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.690790 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:29.691681 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:29.700780 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-bb689a82-5036-40b1-b653-355af49c49df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:29.712077 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-bb689a82-5036-40b1-b653-355af49c49df tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.177219 Sep 08 14:07:29.712077 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 469/941] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:29 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:29.734326 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.734326 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.734326 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.734326 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.734954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.734954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.933348 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:29.942705 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:29.944560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:29.946043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2d82b335-c879-40d4-9877-d7c09cabc9d2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.260231 Sep 08 14:07:29.958998 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 473/942] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:29 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:07:30.432992 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c8455195-e263-49de-a24f-62bf1656c09b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:30.432992 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c8455195-e263-49de-a24f-62bf1656c09b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:30.436826 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8455195-e263-49de-a24f-62bf1656c09b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.437316 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8455195-e263-49de-a24f-62bf1656c09b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.437747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8455195-e263-49de-a24f-62bf1656c09b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.438447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8455195-e263-49de-a24f-62bf1656c09b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.438919 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8455195-e263-49de-a24f-62bf1656c09b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.439338 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c8455195-e263-49de-a24f-62bf1656c09b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.555417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-8ba54fc0-8512-4a34-b4b8-6b309b0244b8 req-8f950cd1-df97-4bc6-8bab-9c0fa1fdeac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6087ad60-8fb4-4165-bbcf-89f27ce4f2e5", "tag": "cff5a913-d4e1-4b6c-a4e7-1170181781b3"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:30.566476 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-8ba54fc0-8512-4a34-b4b8-6b309b0244b8 req-8f950cd1-df97-4bc6-8bab-9c0fa1fdeac6 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.567000 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-8ba54fc0-8512-4a34-b4b8-6b309b0244b8 req-8f950cd1-df97-4bc6-8bab-9c0fa1fdeac6 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.567623 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-8ba54fc0-8512-4a34-b4b8-6b309b0244b8 req-8f950cd1-df97-4bc6-8bab-9c0fa1fdeac6 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.580614 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-8ba54fc0-8512-4a34-b4b8-6b309b0244b8 req-8f950cd1-df97-4bc6-8bab-9c0fa1fdeac6 service nova] Creating event network-changed:cff5a913-d4e1-4b6c-a4e7-1170181781b3 for instance 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 on hv-cinder-84773 Sep 08 14:07:30.587523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-8ba54fc0-8512-4a34-b4b8-6b309b0244b8 req-8f950cd1-df97-4bc6-8bab-9c0fa1fdeac6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035216 Sep 08 14:07:30.588763 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 474/943] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:30.609204 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c8455195-e263-49de-a24f-62bf1656c09b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:30.615657 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c8455195-e263-49de-a24f-62bf1656c09b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1682 microversion: 2.1 time: 0.189749 Sep 08 14:07:30.616249 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 470/944] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:30 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:30.743565 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8a2153e9-61b6-4ead-89c4-b63c6986cd45 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:30.744707 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8a2153e9-61b6-4ead-89c4-b63c6986cd45 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:30.751339 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a2153e9-61b6-4ead-89c4-b63c6986cd45 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.752100 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a2153e9-61b6-4ead-89c4-b63c6986cd45 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.752528 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a2153e9-61b6-4ead-89c4-b63c6986cd45 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.753259 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a2153e9-61b6-4ead-89c4-b63c6986cd45 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.755221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a2153e9-61b6-4ead-89c4-b63c6986cd45 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.755221 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8a2153e9-61b6-4ead-89c4-b63c6986cd45 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.928968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8a2153e9-61b6-4ead-89c4-b63c6986cd45 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:30.939012 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8a2153e9-61b6-4ead-89c4-b63c6986cd45 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.199935 Sep 08 14:07:30.955312 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 475/945] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:30 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:30.976621 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:30.976621 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:30.984967 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.985819 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.986540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.987626 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.988327 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.989088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.999354 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-109c40fc-9762-430f-a872-83abbdfbb4e2 req-8ff702d0-e3d6-4052-a39d-2ed8f578cdcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e8a357-9c5c-41db-8440-b5ebe04b6c8c", "name": "network-vif-deleted", "tag": "a93a84a1-d56f-4e9f-a443-a8184787c4a9"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:31.015082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-109c40fc-9762-430f-a872-83abbdfbb4e2 req-8ff702d0-e3d6-4052-a39d-2ed8f578cdcf service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.015569 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-109c40fc-9762-430f-a872-83abbdfbb4e2 req-8ff702d0-e3d6-4052-a39d-2ed8f578cdcf service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.016163 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-109c40fc-9762-430f-a872-83abbdfbb4e2 req-8ff702d0-e3d6-4052-a39d-2ed8f578cdcf service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.029804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-109c40fc-9762-430f-a872-83abbdfbb4e2 req-8ff702d0-e3d6-4052-a39d-2ed8f578cdcf service nova] Creating event network-vif-deleted:a93a84a1-d56f-4e9f-a443-a8184787c4a9 for instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c on hv-cinder-84773 Sep 08 14:07:31.035829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-109c40fc-9762-430f-a872-83abbdfbb4e2 req-8ff702d0-e3d6-4052-a39d-2ed8f578cdcf service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045705 Sep 08 14:07:31.036903 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 476/946] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:31.457660 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:31.467825 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:31.469504 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:31.470883 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-323ac26e-ab6b-414d-aa11-66cc8d3781a4 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.500655 Sep 08 14:07:31.471924 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 471/947] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:30 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:31.642003 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:31.642712 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:31.644729 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=66 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:31.652444 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.656560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.656560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.656560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.656560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.656922 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.699164 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.699649 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.700170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.700661 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lazy-loading 'fault' on Instance uuid 53e8a357-9c5c-41db-8440-b5ebe04b6c8c {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:31.970408 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a2e4eb71-401f-43b4-b64c-2d51f007b959 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:31.972912 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a2e4eb71-401f-43b4-b64c-2d51f007b959 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:31.987010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2e4eb71-401f-43b4-b64c-2d51f007b959 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.987847 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2e4eb71-401f-43b4-b64c-2d51f007b959 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.988462 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2e4eb71-401f-43b4-b64c-2d51f007b959 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.989578 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2e4eb71-401f-43b4-b64c-2d51f007b959 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.990354 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2e4eb71-401f-43b4-b64c-2d51f007b959 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.990973 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a2e4eb71-401f-43b4-b64c-2d51f007b959 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:32.060043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:32.070950 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3d7d590c-9604-4fa0-95fa-03e690c2739b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1332 microversion: 2.1 time: 0.433889 Sep 08 14:07:32.071534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 477/948] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:31 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1332 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:32.219854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a2e4eb71-401f-43b4-b64c-2d51f007b959 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:32.236457 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a2e4eb71-401f-43b4-b64c-2d51f007b959 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.278399 Sep 08 14:07:32.243235 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 472/949] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:31 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:32.505276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:32.506029 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:32.515540 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:32.516199 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:32.516735 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:32.518756 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:32.519380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:32.520966 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:32.667266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:32.676276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:32.677766 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:32.679072 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ba413c4e-686e-4868-a3f0-ae859c010ebd tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1730 microversion: 2.20 time: 0.182832 Sep 08 14:07:32.679642 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 478/950] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:32 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:33.097339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:33.097931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:33.105096 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.105573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.106003 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.106690 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.107163 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.107582 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.138786 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.139405 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.139846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.140293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lazy-loading 'fault' on Instance uuid 53e8a357-9c5c-41db-8440-b5ebe04b6c8c {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:33.181748 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb41eb66e8140a6999b0bddab3c4afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681592d8b63a438c8b4893eca9a3f04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:33.189412 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3eb68e28-e57b-4fa6-9f00-7acb52bf51fc tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 200 len: 1332 microversion: 2.1 time: 0.096137 Sep 08 14:07:33.190037 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 473/951] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:33 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:33.263368 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f71d4ae7-376b-4653-9dd4-073b6c8e15cc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:33.264041 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f71d4ae7-376b-4653-9dd4-073b6c8e15cc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:33.270467 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f71d4ae7-376b-4653-9dd4-073b6c8e15cc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.270973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f71d4ae7-376b-4653-9dd4-073b6c8e15cc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.271403 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f71d4ae7-376b-4653-9dd4-073b6c8e15cc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.272089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f71d4ae7-376b-4653-9dd4-073b6c8e15cc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.272531 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f71d4ae7-376b-4653-9dd4-073b6c8e15cc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.272945 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f71d4ae7-376b-4653-9dd4-073b6c8e15cc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.403084 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f71d4ae7-376b-4653-9dd4-073b6c8e15cc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:33.413631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f71d4ae7-376b-4653-9dd4-073b6c8e15cc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.154362 Sep 08 14:07:33.414216 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 479/952] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:33 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:33.705999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:33.706603 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:33.712682 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.713161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.713593 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.714477 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.715161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.715590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.860521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:33.869934 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:33.871476 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:33.872881 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c971b7aa-c213-416c-8b8d-1c29b7fb5283 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1717 microversion: 2.20 time: 0.171244 Sep 08 14:07:33.873963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 474/953] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:07:33 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:07:34.213009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:34.213560 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:34.220023 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:34.220564 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:34.220915 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:34.221611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:34.222062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:34.222481 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:34.236597 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c HTTP/1.1 Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:07:34.238301 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:34.240046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '53e8a357-9c5c-41db-8440-b5ebe04b6c8c'} Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:34.240890 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:34.242385 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:34.244711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:34.244711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-361276b6-95ce-4cde-82fc-fc8c76025668 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 404 len: 111 microversion: 2.1 time: 0.030887 Sep 08 14:07:34.244711 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 480/954] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:34 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:34.250722 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2242a9a7-26a0-4164-a6c3-fa71f3e212a6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '.version_select at 0x7f51fbe2dd30>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:34.326117 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2242a9a7-26a0-4164-a6c3-fa71f3e212a6 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057944249" status: 202 len: 0 microversion: 2.1 time: 0.079140 Sep 08 14:07:34.326716 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 475/955] 10.222.0.91 () {58 vars in 1221 bytes} [Thu Sep 8 14:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057944249 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:07:34.437105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e771b7df-db81-46b4-8f35-ea8ae3843870 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:34.437992 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e771b7df-db81-46b4-8f35-ea8ae3843870 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:34.444695 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e771b7df-db81-46b4-8f35-ea8ae3843870 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:34.446812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e771b7df-db81-46b4-8f35-ea8ae3843870 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:34.446812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e771b7df-db81-46b4-8f35-ea8ae3843870 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:34.446812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e771b7df-db81-46b4-8f35-ea8ae3843870 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:34.447137 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e771b7df-db81-46b4-8f35-ea8ae3843870 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:34.447357 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e771b7df-db81-46b4-8f35-ea8ae3843870 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:34.595309 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e771b7df-db81-46b4-8f35-ea8ae3843870 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:34.604379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e771b7df-db81-46b4-8f35-ea8ae3843870 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.170809 Sep 08 14:07:34.604914 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 481/956] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:34 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:35.628071 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4af015f7-f675-4814-b2e4-38e6b54e4fe1 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:35.628674 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4af015f7-f675-4814-b2e4-38e6b54e4fe1 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:35.639982 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4af015f7-f675-4814-b2e4-38e6b54e4fe1 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:35.640489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4af015f7-f675-4814-b2e4-38e6b54e4fe1 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:35.640911 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4af015f7-f675-4814-b2e4-38e6b54e4fe1 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:35.641625 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4af015f7-f675-4814-b2e4-38e6b54e4fe1 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:35.642078 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4af015f7-f675-4814-b2e4-38e6b54e4fe1 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:35.642506 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4af015f7-f675-4814-b2e4-38e6b54e4fe1 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:35.662009 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:35.781460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4af015f7-f675-4814-b2e4-38e6b54e4fe1 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:35.789812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4af015f7-f675-4814-b2e4-38e6b54e4fe1 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.165596 Sep 08 14:07:35.791451 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 476/957] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:35 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:36.813665 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-03705b6f-8520-453d-b84f-68a62ea423db tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:36.814294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-03705b6f-8520-453d-b84f-68a62ea423db tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:36.820906 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03705b6f-8520-453d-b84f-68a62ea423db tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:36.821540 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03705b6f-8520-453d-b84f-68a62ea423db tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:36.822641 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03705b6f-8520-453d-b84f-68a62ea423db tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:36.823365 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03705b6f-8520-453d-b84f-68a62ea423db tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:36.823818 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03705b6f-8520-453d-b84f-68a62ea423db tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:36.824236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-03705b6f-8520-453d-b84f-68a62ea423db tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:36.956424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-03705b6f-8520-453d-b84f-68a62ea423db tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:36.964037 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-03705b6f-8520-453d-b84f-68a62ea423db tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.154383 Sep 08 14:07:36.964601 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 482/958] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:36 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:37.986635 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ed8aacf1-8921-4350-940b-d24dbf143830 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:37.987256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ed8aacf1-8921-4350-940b-d24dbf143830 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:37.994272 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed8aacf1-8921-4350-940b-d24dbf143830 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:37.994760 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed8aacf1-8921-4350-940b-d24dbf143830 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:37.995236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed8aacf1-8921-4350-940b-d24dbf143830 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:37.995962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed8aacf1-8921-4350-940b-d24dbf143830 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:37.996419 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed8aacf1-8921-4350-940b-d24dbf143830 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:37.996844 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ed8aacf1-8921-4350-940b-d24dbf143830 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.126241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ed8aacf1-8921-4350-940b-d24dbf143830 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:38.134045 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ed8aacf1-8921-4350-940b-d24dbf143830 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.151418 Sep 08 14:07:38.135293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 477/959] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:37 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:38.521864 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:38.522368 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:38.529112 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:38.529602 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:38.530045 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.530730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:38.531216 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:38.531645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.548562 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: DELETE /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c HTTP/1.1 Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:07:38.550148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:38.551751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '53e8a357-9c5c-41db-8440-b5ebe04b6c8c'} Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:38.552590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:38.554076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:38.565683 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:38.565683 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-502dbb1e-feec-478d-be61-ef49f7c1e875 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 404 len: 111 microversion: 2.1 time: 0.033596 Sep 08 14:07:38.565683 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 483/960] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:38 2022] DELETE /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:38.573277 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:38.573895 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 53e8a357-9c5c-41db-8440-b5ebe04b6c8c] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:38.580360 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:38.580853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:38.581291 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.581995 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:38.582452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:38.582885 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.596955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c HTTP/1.1 Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:07:38.599863 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:38.601640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '53e8a357-9c5c-41db-8440-b5ebe04b6c8c'} Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:38.602537 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. Sep 08 14:07:38.604520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:38.606181 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance 53e8a357-9c5c-41db-8440-b5ebe04b6c8c could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:38.606181 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3e09173e-fb46-4423-82a8-92337091621b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c" status: 404 len: 111 microversion: 2.1 time: 0.030862 Sep 08 14:07:38.606181 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 478/961] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:38 2022] GET /compute/v2.1/servers/53e8a357-9c5c-41db-8440-b5ebe04b6c8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:07:38.855867 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-617dae48-b91a-4a88-b7b8-ff9694347983 req-8406b98f-228c-4ba7-ac55-eb879a3a7f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6087ad60-8fb4-4165-bbcf-89f27ce4f2e5", "name": "network-vif-plugged", "status": "completed", "tag": "cff5a913-d4e1-4b6c-a4e7-1170181781b3"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:38.866162 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-617dae48-b91a-4a88-b7b8-ff9694347983 req-8406b98f-228c-4ba7-ac55-eb879a3a7f47 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:38.867170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-617dae48-b91a-4a88-b7b8-ff9694347983 req-8406b98f-228c-4ba7-ac55-eb879a3a7f47 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:38.867170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-617dae48-b91a-4a88-b7b8-ff9694347983 req-8406b98f-228c-4ba7-ac55-eb879a3a7f47 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.878483 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-617dae48-b91a-4a88-b7b8-ff9694347983 req-8406b98f-228c-4ba7-ac55-eb879a3a7f47 service nova] Creating event network-vif-plugged:cff5a913-d4e1-4b6c-a4e7-1170181781b3 for instance 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 on hv-cinder-84773 Sep 08 14:07:38.883724 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-617dae48-b91a-4a88-b7b8-ff9694347983 req-8406b98f-228c-4ba7-ac55-eb879a3a7f47 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033089 Sep 08 14:07:38.884337 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 484/962] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:39.158057 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6ea00037-c876-4eee-99ac-b79c22c9a89b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:39.158660 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6ea00037-c876-4eee-99ac-b79c22c9a89b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:39.165191 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ea00037-c876-4eee-99ac-b79c22c9a89b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.166304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ea00037-c876-4eee-99ac-b79c22c9a89b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.166966 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ea00037-c876-4eee-99ac-b79c22c9a89b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.167809 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ea00037-c876-4eee-99ac-b79c22c9a89b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.168261 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ea00037-c876-4eee-99ac-b79c22c9a89b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.168679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ea00037-c876-4eee-99ac-b79c22c9a89b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.314512 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6ea00037-c876-4eee-99ac-b79c22c9a89b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:39.323121 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6ea00037-c876-4eee-99ac-b79c22c9a89b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.168974 Sep 08 14:07:39.323711 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 479/963] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:39 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:39.895016 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:39.895541 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:39.902447 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.902955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.903407 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.904078 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.904525 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.904945 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.907699 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=100 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:39.919404 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: DELETE /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 HTTP/1.1 Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:07:39.921168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:07:39.922764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '789dd836-53d0-47a2-99a0-543e2997ad11'} Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:39.923730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:07:39.925151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.926534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:39.926534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ddc5ebe4-b532-435b-8595-cfd0d4ec36aa tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 404 len: 111 microversion: 2.1 time: 0.031922 Sep 08 14:07:39.926534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 485/964] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:39 2022] DELETE /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:39.931649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:39.932293 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 789dd836-53d0-47a2-99a0-543e2997ad11] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:39.939014 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.939542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.939987 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.943937 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.943937 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.943937 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.955234 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 HTTP/1.1 Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:07:39.956873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:07:39.958423 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '789dd836-53d0-47a2-99a0-543e2997ad11'} Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:39.959331 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. Sep 08 14:07:39.960758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.962028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance 789dd836-53d0-47a2-99a0-543e2997ad11 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:39.962028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d370bb2f-cde6-4a01-b9ff-4e192bc31038 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11" status: 404 len: 111 microversion: 2.1 time: 0.030695 Sep 08 14:07:39.962028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 480/965] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:39 2022] GET /compute/v2.1/servers/789dd836-53d0-47a2-99a0-543e2997ad11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:39.967709 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:39.968210 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:39.974457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.974976 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.975422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.976118 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.976590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.977018 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.990723 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: DELETE /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b HTTP/1.1 Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:07:39.992299 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:07:39.993872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '175ddc71-f731-4fa7-8de5-245b36c3c13b'} Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:39.994797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:07:39.996331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:39.997894 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:39.997894 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a8e2dabd-feb0-484b-80e0-196fd0b17c7e tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 404 len: 111 microversion: 2.1 time: 0.030372 Sep 08 14:07:39.997894 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 486/966] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:39 2022] DELETE /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:40.002671 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:40.003316 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: 175ddc71-f731-4fa7-8de5-245b36c3c13b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:40.009326 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.009838 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.010268 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.011014 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.011470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.011895 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.025384 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b HTTP/1.1 Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:07:40.026944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:07:40.028344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '175ddc71-f731-4fa7-8de5-245b36c3c13b'} Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:40.029082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. Sep 08 14:07:40.030297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:40.031408 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance 175ddc71-f731-4fa7-8de5-245b36c3c13b could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:40.031408 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0ac73474-9169-4130-86ff-ab05abe73320 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b" status: 404 len: 111 microversion: 2.1 time: 0.030006 Sep 08 14:07:40.031408 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 481/967] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:39 2022] GET /compute/v2.1/servers/175ddc71-f731-4fa7-8de5-245b36c3c13b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:40.353735 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-62f9d804-7efa-4610-8475-e3e99df34d51 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:40.354350 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-62f9d804-7efa-4610-8475-e3e99df34d51 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:40.360935 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-62f9d804-7efa-4610-8475-e3e99df34d51 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.361424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-62f9d804-7efa-4610-8475-e3e99df34d51 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.361970 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-62f9d804-7efa-4610-8475-e3e99df34d51 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.362668 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-62f9d804-7efa-4610-8475-e3e99df34d51 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.363159 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-62f9d804-7efa-4610-8475-e3e99df34d51 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.363586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-62f9d804-7efa-4610-8475-e3e99df34d51 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.495550 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-62f9d804-7efa-4610-8475-e3e99df34d51 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:40.503787 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-62f9d804-7efa-4610-8475-e3e99df34d51 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1313 microversion: 2.1 time: 0.153981 Sep 08 14:07:40.504357 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 487/968] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:40 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:41.298745 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:41.299311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:41.305951 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.309361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.309361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.309361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.309361 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.309806 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.322636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: DELETE /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 HTTP/1.1 Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:07:41.324941 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:07:41.326532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'edd10060-2469-49e3-a8c3-949a359181f8'} Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:41.327450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:07:41.328914 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:07:41.330543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:41.330543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-00882eb9-4bb2-4386-8ee4-f81c3fd62a5b tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "DELETE /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 404 len: 111 microversion: 2.1 time: 0.031459 Sep 08 14:07:41.330543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 482/969] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:41 2022] DELETE /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:41.335527 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:41.336166 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] [instance: edd10060-2469-49e3-a8c3-949a359181f8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:41.342869 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.343419 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.343861 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.344544 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.344992 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.345407 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.358421 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] HTTP exception thrown: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Request method failure captured: Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 HTTP/1.1 Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfVh8HzwNCcu9mT6qCb43Cj4bzo2fjFPjwgbeOmk1gGo6dY4qXKeccqY0idaseksS28c-M56ikbq2bCHW9v4iNH3bpnOp1DcOb8SU4__v_HBw8vxFdA4-bd1uYKKt3vvQKPNm-e_f5506wlBXRSq4baD3ev0R5bnM58q-RVMmz0ZEYQ Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:07:41.360294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_681592d8b63a438c8b4893eca9a3f04b", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/681592d8b63a438c8b4893eca9a3f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 681592d8b63a438c8b4893eca9a3f04b Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2108320399 Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: beb41eb66e8140a6999b0bddab3c4afd Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeNegativeTest-2108320399-project Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:07:41.362010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': 'edd10060-2469-49e3-a8c3-949a359181f8'} Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:41.362988 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. Sep 08 14:07:41.364458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:41.365752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] Returning 404 to user: Instance edd10060-2469-49e3-a8c3-949a359181f8 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:41.365752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8273f594-4de4-4bdc-962a-1c141a7091a4 tempest-AttachVolumeNegativeTest-2108320399 tempest-AttachVolumeNegativeTest-2108320399-project] 10.222.0.91 "GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8" status: 404 len: 111 microversion: 2.1 time: 0.030817 Sep 08 14:07:41.365752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 488/970] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:41 2022] GET /compute/v2.1/servers/edd10060-2469-49e3-a8c3-949a359181f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:41.527870 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-11ddb6a8-49f1-46d9-8e3f-ad4f5fe1ca03 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:41.528389 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-11ddb6a8-49f1-46d9-8e3f-ad4f5fe1ca03 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:41.534341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11ddb6a8-49f1-46d9-8e3f-ad4f5fe1ca03 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.534822 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11ddb6a8-49f1-46d9-8e3f-ad4f5fe1ca03 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.535316 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11ddb6a8-49f1-46d9-8e3f-ad4f5fe1ca03 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.535974 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11ddb6a8-49f1-46d9-8e3f-ad4f5fe1ca03 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.536426 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11ddb6a8-49f1-46d9-8e3f-ad4f5fe1ca03 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.536861 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-11ddb6a8-49f1-46d9-8e3f-ad4f5fe1ca03 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.747352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-11ddb6a8-49f1-46d9-8e3f-ad4f5fe1ca03 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:41.755278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-11ddb6a8-49f1-46d9-8e3f-ad4f5fe1ca03 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1497 microversion: 2.1 time: 0.231658 Sep 08 14:07:41.755834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 483/971] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:41 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1497 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:42.756718 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-491303d8-b19b-4568-8a68-4a46b061f886 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:42.757601 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-491303d8-b19b-4568-8a68-4a46b061f886 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:42.770578 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-491303d8-b19b-4568-8a68-4a46b061f886 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:42.771329 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-491303d8-b19b-4568-8a68-4a46b061f886 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:42.772090 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-491303d8-b19b-4568-8a68-4a46b061f886 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:42.772822 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-491303d8-b19b-4568-8a68-4a46b061f886 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:42.773740 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-491303d8-b19b-4568-8a68-4a46b061f886 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:42.775641 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-491303d8-b19b-4568-8a68-4a46b061f886 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:42.806428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-491303d8-b19b-4568-8a68-4a46b061f886 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Going to try to terminate instance {{(pid=133059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:07:43.157980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-491303d8-b19b-4568-8a68-4a46b061f886 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "DELETE /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 204 len: 0 microversion: 2.1 time: 0.406574 Sep 08 14:07:43.158764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 489/972] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:42 2022] DELETE /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:07:43.169980 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b4a813ec-4298-4750-aab4-cc3eb4ee4848 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:43.171312 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b4a813ec-4298-4750-aab4-cc3eb4ee4848 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:43.179302 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b4a813ec-4298-4750-aab4-cc3eb4ee4848 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.179789 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b4a813ec-4298-4750-aab4-cc3eb4ee4848 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.182228 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b4a813ec-4298-4750-aab4-cc3eb4ee4848 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.182999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b4a813ec-4298-4750-aab4-cc3eb4ee4848 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.183500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b4a813ec-4298-4750-aab4-cc3eb4ee4848 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.183938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b4a813ec-4298-4750-aab4-cc3eb4ee4848 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.369967 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b4a813ec-4298-4750-aab4-cc3eb4ee4848 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:43.376256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b4a813ec-4298-4750-aab4-cc3eb4ee4848 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1503 microversion: 2.1 time: 0.209923 Sep 08 14:07:43.376834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 484/973] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:43 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:44.401422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-32c72608-d45c-4842-9329-0dad154abdd5 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:44.403384 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-32c72608-d45c-4842-9329-0dad154abdd5 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:44.411381 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32c72608-d45c-4842-9329-0dad154abdd5 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:44.411878 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32c72608-d45c-4842-9329-0dad154abdd5 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:44.412318 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32c72608-d45c-4842-9329-0dad154abdd5 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:44.413029 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32c72608-d45c-4842-9329-0dad154abdd5 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:44.413483 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32c72608-d45c-4842-9329-0dad154abdd5 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:44.413912 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-32c72608-d45c-4842-9329-0dad154abdd5 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:44.571472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-32c72608-d45c-4842-9329-0dad154abdd5 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:44.579702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-32c72608-d45c-4842-9329-0dad154abdd5 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1503 microversion: 2.1 time: 0.184016 Sep 08 14:07:44.580269 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 490/974] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:44 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:45.603312 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e2df5aed-18b8-4930-8f3d-d8d3dbba4936 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:45.603926 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e2df5aed-18b8-4930-8f3d-d8d3dbba4936 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:45.611681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2df5aed-18b8-4930-8f3d-d8d3dbba4936 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:45.614161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2df5aed-18b8-4930-8f3d-d8d3dbba4936 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:45.614161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2df5aed-18b8-4930-8f3d-d8d3dbba4936 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:45.615431 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2df5aed-18b8-4930-8f3d-d8d3dbba4936 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:45.616323 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2df5aed-18b8-4930-8f3d-d8d3dbba4936 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:45.617037 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e2df5aed-18b8-4930-8f3d-d8d3dbba4936 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:45.779834 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e2df5aed-18b8-4930-8f3d-d8d3dbba4936 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:45.790118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e2df5aed-18b8-4930-8f3d-d8d3dbba4936 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1503 microversion: 2.1 time: 0.190646 Sep 08 14:07:45.803899 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 485/975] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:45 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:45.931966 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-881152f4-3ac4-4d8a-b638-66025b32bacb req-b8b2221b-e039-4750-9500-fff355824548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6087ad60-8fb4-4165-bbcf-89f27ce4f2e5", "name": "network-vif-deleted", "tag": "cff5a913-d4e1-4b6c-a4e7-1170181781b3"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:45.942389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-881152f4-3ac4-4d8a-b638-66025b32bacb req-b8b2221b-e039-4750-9500-fff355824548 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:45.942923 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-881152f4-3ac4-4d8a-b638-66025b32bacb req-b8b2221b-e039-4750-9500-fff355824548 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:45.943370 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-881152f4-3ac4-4d8a-b638-66025b32bacb req-b8b2221b-e039-4750-9500-fff355824548 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:45.957492 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-881152f4-3ac4-4d8a-b638-66025b32bacb req-b8b2221b-e039-4750-9500-fff355824548 service nova] Creating event network-vif-deleted:cff5a913-d4e1-4b6c-a4e7-1170181781b3 for instance 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 on hv-cinder-84773 Sep 08 14:07:45.962470 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-881152f4-3ac4-4d8a-b638-66025b32bacb req-b8b2221b-e039-4750-9500-fff355824548 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Sep 08 14:07:45.963091 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 491/976] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:46.816901 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:46.818448 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:46.826971 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:46.827566 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:46.828075 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:46.828853 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:46.829375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:46.830017 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:46.878843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:46.878843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:46.878843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:46.878843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lazy-loading 'fault' on Instance uuid 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:46.925774 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:46.934211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5392ec89-f15b-41f2-b137-f28f7632caa6 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 200 len: 1303 microversion: 2.1 time: 0.122850 Sep 08 14:07:46.939044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 486/977] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:46 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:47.959592 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:47.960472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:47.967137 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:47.973916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:47.973916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:47.973916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:47.973916 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:47.974417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:47.984032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] HTTP exception thrown: Instance 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 could not be found. Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Request method failure captured: Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 HTTP/1.1 Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfcLnHCMmkbXiwaNlYY44RkUctgCIg4rzIk_YHpAw0_0VNplNvReh04aLxrEyhvz4qI_-6_yfJVamzjbXH0pt4Uz0XKPR5RFMLs3Ix5DZc7Qf4xGJzDYD3iAKT3TWEEuhiI_dL99I4xPxvoqyB4wA-6seK1q7uKmB71QSbbfoA4g6lk Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: fefb0f83ce4447cc9223c383a256676a Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-VolumesActionsTest-1103795049 Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:07:47.985679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/fefb0f83ce4447cc9223c383a256676a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/fefb0f83ce4447cc9223c383a256676a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_fefb0f83ce4447cc9223c383a256676a", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/fefb0f83ce4447cc9223c383a256676a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-VolumesActionsTest-1103795049 Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: fefb0f83ce4447cc9223c383a256676a Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-VolumesActionsTest-1103795049 Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-VolumesActionsTest-1103795049-project Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: b4cc11524fe542c5a5361b3630e6d3a6 Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-VolumesActionsTest-1103795049-project Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 could not be found. Sep 08 14:07:47.987255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '6087ad60-8fb4-4165-bbcf-89f27ce4f2e5'} Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 could not be found. Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:47.988457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 could not be found. Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 could not be found. Sep 08 14:07:47.990406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:07:47.991785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Returning 404 to user: Instance 6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:47.991785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-91b61d03-83fe-4628-b112-4d5f055b9438 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5" status: 404 len: 111 microversion: 2.1 time: 0.032475 Sep 08 14:07:47.991785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 492/978] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:47 2022] GET /compute/v2.1/servers/6087ad60-8fb4-4165-bbcf-89f27ce4f2e5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:48.094846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-220227194", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "networks": [{"uuid": "8a6b9b27-99be-4a97-bac8-eb6cb1a0fd4d"}]}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:48.152886 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] validate_networks() for [('8a6b9b27-99be-4a97-bac8-eb6cb1a0fd4d', None, None, None, None, None)] {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:07:48.550306 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:07:48.550724 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:07:48.551228 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:07:48.551632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:07:48.552039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:07:48.561445 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:48.561917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:48.562368 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:48.563134 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:48.563581 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:48.563999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:48.580939 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Getting quotas for project fefb0f83ce4447cc9223c383a256676a. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:07:48.584849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Getting quotas for user b4cc11524fe542c5a5361b3630e6d3a6 and project fefb0f83ce4447cc9223c383a256676a. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:07:48.596315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:07:48.598884 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:07:48.870206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1e17f2fe-a64f-4517-bfe4-4b168c05be2f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779199 Sep 08 14:07:48.871561 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 487/979] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:07:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:07:48.882517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e8eb584e-0df1-49c0-b165-537b16c7d657 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:48.883247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e8eb584e-0df1-49c0-b165-537b16c7d657 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:48.939496 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e8eb584e-0df1-49c0-b165-537b16c7d657 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:48.946674 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e8eb584e-0df1-49c0-b165-537b16c7d657 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1213 microversion: 2.1 time: 0.068006 Sep 08 14:07:48.958961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 493/980] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:48 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:49.971090 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f65fdd5b-a17b-4c72-9897-826493411afc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:49.971700 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f65fdd5b-a17b-4c72-9897-826493411afc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:49.977889 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f65fdd5b-a17b-4c72-9897-826493411afc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:49.978373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f65fdd5b-a17b-4c72-9897-826493411afc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:49.978806 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f65fdd5b-a17b-4c72-9897-826493411afc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:49.979520 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f65fdd5b-a17b-4c72-9897-826493411afc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:49.979972 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f65fdd5b-a17b-4c72-9897-826493411afc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:49.980424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f65fdd5b-a17b-4c72-9897-826493411afc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:50.046532 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f65fdd5b-a17b-4c72-9897-826493411afc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:50.054680 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f65fdd5b-a17b-4c72-9897-826493411afc tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1217 microversion: 2.1 time: 0.088337 Sep 08 14:07:50.055294 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 488/981] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:49 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:51.078174 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1b0f8c7a-826e-49e7-9449-ddb268e897b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:51.082941 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1b0f8c7a-826e-49e7-9449-ddb268e897b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:51.086127 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c7a-826e-49e7-9449-ddb268e897b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:51.086614 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c7a-826e-49e7-9449-ddb268e897b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:51.087160 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c7a-826e-49e7-9449-ddb268e897b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:51.087857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c7a-826e-49e7-9449-ddb268e897b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:51.088311 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c7a-826e-49e7-9449-ddb268e897b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:51.088736 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c7a-826e-49e7-9449-ddb268e897b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:51.158448 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1b0f8c7a-826e-49e7-9449-ddb268e897b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:51.167479 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1b0f8c7a-826e-49e7-9449-ddb268e897b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1265 microversion: 2.1 time: 0.093761 Sep 08 14:07:51.168724 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 494/982] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:51 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:52.190968 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-285fbbda-83dc-4e79-b380-8875f8ebc766 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:52.191576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-285fbbda-83dc-4e79-b380-8875f8ebc766 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:52.198141 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-285fbbda-83dc-4e79-b380-8875f8ebc766 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:52.198626 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-285fbbda-83dc-4e79-b380-8875f8ebc766 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:52.199097 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-285fbbda-83dc-4e79-b380-8875f8ebc766 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:52.199785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-285fbbda-83dc-4e79-b380-8875f8ebc766 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:52.200231 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-285fbbda-83dc-4e79-b380-8875f8ebc766 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:52.200649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-285fbbda-83dc-4e79-b380-8875f8ebc766 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:52.345203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-285fbbda-83dc-4e79-b380-8875f8ebc766 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:52.352252 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-285fbbda-83dc-4e79-b380-8875f8ebc766 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.165135 Sep 08 14:07:52.352833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 489/983] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:52 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:53.159578 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-30dd9845-a14a-4d1b-a9a4-d82b138dc3b3 req-2928c16c-ce5f-4cd0-a3f0-864314596b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b8dfaa-616e-4d51-8ae4-1ad1040c69f4", "tag": "29b6607d-96a3-4a06-9906-46a22f0a210b"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:53.169931 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-30dd9845-a14a-4d1b-a9a4-d82b138dc3b3 req-2928c16c-ce5f-4cd0-a3f0-864314596b58 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:53.170525 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-30dd9845-a14a-4d1b-a9a4-d82b138dc3b3 req-2928c16c-ce5f-4cd0-a3f0-864314596b58 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:53.171185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-30dd9845-a14a-4d1b-a9a4-d82b138dc3b3 req-2928c16c-ce5f-4cd0-a3f0-864314596b58 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:53.183373 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-30dd9845-a14a-4d1b-a9a4-d82b138dc3b3 req-2928c16c-ce5f-4cd0-a3f0-864314596b58 service nova] Creating event network-changed:29b6607d-96a3-4a06-9906-46a22f0a210b for instance 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 on hv-cinder-84773 Sep 08 14:07:53.190092 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-30dd9845-a14a-4d1b-a9a4-d82b138dc3b3 req-2928c16c-ce5f-4cd0-a3f0-864314596b58 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034251 Sep 08 14:07:53.190800 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 495/984] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:53.377010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b7c4257c-d528-4800-83eb-acecba56e0ca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:53.377623 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b7c4257c-d528-4800-83eb-acecba56e0ca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:53.385039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b7c4257c-d528-4800-83eb-acecba56e0ca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:53.385531 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b7c4257c-d528-4800-83eb-acecba56e0ca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:53.385964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b7c4257c-d528-4800-83eb-acecba56e0ca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:53.388047 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b7c4257c-d528-4800-83eb-acecba56e0ca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:53.388047 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b7c4257c-d528-4800-83eb-acecba56e0ca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:53.388047 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b7c4257c-d528-4800-83eb-acecba56e0ca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:53.529175 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b7c4257c-d528-4800-83eb-acecba56e0ca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:53.537640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b7c4257c-d528-4800-83eb-acecba56e0ca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.164499 Sep 08 14:07:53.538238 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 490/985] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:53 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:54.562533 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-28167f40-2918-4d3e-8c1c-c35e08cf52b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:54.563257 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-28167f40-2918-4d3e-8c1c-c35e08cf52b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:54.569461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28167f40-2918-4d3e-8c1c-c35e08cf52b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:54.569940 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28167f40-2918-4d3e-8c1c-c35e08cf52b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:54.570371 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28167f40-2918-4d3e-8c1c-c35e08cf52b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:54.571119 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28167f40-2918-4d3e-8c1c-c35e08cf52b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:54.571569 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28167f40-2918-4d3e-8c1c-c35e08cf52b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:54.571994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-28167f40-2918-4d3e-8c1c-c35e08cf52b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:54.704999 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-28167f40-2918-4d3e-8c1c-c35e08cf52b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:54.712619 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-28167f40-2918-4d3e-8c1c-c35e08cf52b8 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.155361 Sep 08 14:07:54.713177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 496/986] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:54 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:55.735593 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-00b762d2-5b11-4f54-ad98-6d0b050fd29c tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:55.736342 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-00b762d2-5b11-4f54-ad98-6d0b050fd29c tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:55.742864 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00b762d2-5b11-4f54-ad98-6d0b050fd29c tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.743373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00b762d2-5b11-4f54-ad98-6d0b050fd29c tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.743802 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00b762d2-5b11-4f54-ad98-6d0b050fd29c tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.744486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00b762d2-5b11-4f54-ad98-6d0b050fd29c tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.744932 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00b762d2-5b11-4f54-ad98-6d0b050fd29c tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.745351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-00b762d2-5b11-4f54-ad98-6d0b050fd29c tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.955041 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-00b762d2-5b11-4f54-ad98-6d0b050fd29c tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:55.962927 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-00b762d2-5b11-4f54-ad98-6d0b050fd29c tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.231416 Sep 08 14:07:55.963594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 491/987] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:55 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:56.986668 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ecc327ab-5cf0-431a-9566-7a6da154c0f9 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:56.987307 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ecc327ab-5cf0-431a-9566-7a6da154c0f9 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:56.993751 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ecc327ab-5cf0-431a-9566-7a6da154c0f9 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:56.994239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ecc327ab-5cf0-431a-9566-7a6da154c0f9 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:56.994676 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ecc327ab-5cf0-431a-9566-7a6da154c0f9 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:56.995422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ecc327ab-5cf0-431a-9566-7a6da154c0f9 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:56.996132 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ecc327ab-5cf0-431a-9566-7a6da154c0f9 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:56.996574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ecc327ab-5cf0-431a-9566-7a6da154c0f9 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.131576 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ecc327ab-5cf0-431a-9566-7a6da154c0f9 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:57.141535 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ecc327ab-5cf0-431a-9566-7a6da154c0f9 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.158864 Sep 08 14:07:57.147606 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 497/988] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:56 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:58.166198 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-48d8d85e-5757-47c1-9441-7da4e162ca7b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:58.166198 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-48d8d85e-5757-47c1-9441-7da4e162ca7b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:58.172007 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48d8d85e-5757-47c1-9441-7da4e162ca7b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.172501 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48d8d85e-5757-47c1-9441-7da4e162ca7b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.173001 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48d8d85e-5757-47c1-9441-7da4e162ca7b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.173699 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48d8d85e-5757-47c1-9441-7da4e162ca7b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.174151 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48d8d85e-5757-47c1-9441-7da4e162ca7b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.174573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-48d8d85e-5757-47c1-9441-7da4e162ca7b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.308629 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-48d8d85e-5757-47c1-9441-7da4e162ca7b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:58.321931 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-48d8d85e-5757-47c1-9441-7da4e162ca7b tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.160906 Sep 08 14:07:58.322513 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 492/989] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:58 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:59.345875 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-00ca96bd-c172-4465-93b6-1db10b2607cb tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:59.346416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-00ca96bd-c172-4465-93b6-1db10b2607cb tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:59.348605 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:59.353495 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00ca96bd-c172-4465-93b6-1db10b2607cb tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.357526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00ca96bd-c172-4465-93b6-1db10b2607cb tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.357526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00ca96bd-c172-4465-93b6-1db10b2607cb tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:59.357526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00ca96bd-c172-4465-93b6-1db10b2607cb tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.357526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00ca96bd-c172-4465-93b6-1db10b2607cb tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.357909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-00ca96bd-c172-4465-93b6-1db10b2607cb tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:59.583116 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-00ca96bd-c172-4465-93b6-1db10b2607cb tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:59.594399 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-00ca96bd-c172-4465-93b6-1db10b2607cb tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.252274 Sep 08 14:07:59.597516 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 498/990] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:59 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:00.619018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0b341957-664b-49e5-bdcb-9b48be8cfb68 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:00.619725 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0b341957-664b-49e5-bdcb-9b48be8cfb68 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:00.621481 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:00.622650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=6 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:00.623837 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:00.628733 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b341957-664b-49e5-bdcb-9b48be8cfb68 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.632278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b341957-664b-49e5-bdcb-9b48be8cfb68 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.632278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b341957-664b-49e5-bdcb-9b48be8cfb68 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.632278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b341957-664b-49e5-bdcb-9b48be8cfb68 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.632278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b341957-664b-49e5-bdcb-9b48be8cfb68 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.632663 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0b341957-664b-49e5-bdcb-9b48be8cfb68 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.761935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0b341957-664b-49e5-bdcb-9b48be8cfb68 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:00.770275 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0b341957-664b-49e5-bdcb-9b48be8cfb68 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.155111 Sep 08 14:08:00.770839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 493/991] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:00 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:01.795387 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c17fecad-b90e-4480-bb5d-a0dd8e03df96 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:01.795387 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c17fecad-b90e-4480-bb5d-a0dd8e03df96 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:01.799244 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:01.802737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c17fecad-b90e-4480-bb5d-a0dd8e03df96 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:01.806933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c17fecad-b90e-4480-bb5d-a0dd8e03df96 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:01.806933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c17fecad-b90e-4480-bb5d-a0dd8e03df96 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:01.806933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c17fecad-b90e-4480-bb5d-a0dd8e03df96 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:01.806933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c17fecad-b90e-4480-bb5d-a0dd8e03df96 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:01.807327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c17fecad-b90e-4480-bb5d-a0dd8e03df96 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:01.944842 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c17fecad-b90e-4480-bb5d-a0dd8e03df96 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:01.954010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c17fecad-b90e-4480-bb5d-a0dd8e03df96 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.163194 Sep 08 14:08:01.954591 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 499/992] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:01 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:02.980251 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-60c2edac-d7d9-48e3-8900-ee6d17186ac7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:02.981502 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-60c2edac-d7d9-48e3-8900-ee6d17186ac7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:02.990882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60c2edac-d7d9-48e3-8900-ee6d17186ac7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.991970 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60c2edac-d7d9-48e3-8900-ee6d17186ac7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.992680 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60c2edac-d7d9-48e3-8900-ee6d17186ac7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:02.994148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60c2edac-d7d9-48e3-8900-ee6d17186ac7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.994820 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60c2edac-d7d9-48e3-8900-ee6d17186ac7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.995553 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-60c2edac-d7d9-48e3-8900-ee6d17186ac7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:03.137840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-60c2edac-d7d9-48e3-8900-ee6d17186ac7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:03.146818 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-60c2edac-d7d9-48e3-8900-ee6d17186ac7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.174210 Sep 08 14:08:03.147538 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 494/993] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:02 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:04.175930 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-547f6722-79b2-4fe9-b011-4e9be1b68313 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:04.176529 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-547f6722-79b2-4fe9-b011-4e9be1b68313 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:04.182740 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-547f6722-79b2-4fe9-b011-4e9be1b68313 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:04.183245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-547f6722-79b2-4fe9-b011-4e9be1b68313 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:04.183673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-547f6722-79b2-4fe9-b011-4e9be1b68313 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:04.184359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-547f6722-79b2-4fe9-b011-4e9be1b68313 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:04.184805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-547f6722-79b2-4fe9-b011-4e9be1b68313 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:04.185857 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-547f6722-79b2-4fe9-b011-4e9be1b68313 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:04.331045 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-547f6722-79b2-4fe9-b011-4e9be1b68313 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:04.338596 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-547f6722-79b2-4fe9-b011-4e9be1b68313 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.168844 Sep 08 14:08:04.339410 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 500/994] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:04 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:05.014720 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-3802122a-76e2-48d5-9418-ffe5b39cf43e req-2c304f78-c2ee-4547-bb69-23ee753f67c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b8dfaa-616e-4d51-8ae4-1ad1040c69f4", "name": "network-vif-plugged", "status": "completed", "tag": "29b6607d-96a3-4a06-9906-46a22f0a210b"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:05.025610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-3802122a-76e2-48d5-9418-ffe5b39cf43e req-2c304f78-c2ee-4547-bb69-23ee753f67c5 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:05.026093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-3802122a-76e2-48d5-9418-ffe5b39cf43e req-2c304f78-c2ee-4547-bb69-23ee753f67c5 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:05.026521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-3802122a-76e2-48d5-9418-ffe5b39cf43e req-2c304f78-c2ee-4547-bb69-23ee753f67c5 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:05.038349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-3802122a-76e2-48d5-9418-ffe5b39cf43e req-2c304f78-c2ee-4547-bb69-23ee753f67c5 service nova] Creating event network-vif-plugged:29b6607d-96a3-4a06-9906-46a22f0a210b for instance 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 on hv-cinder-84773 Sep 08 14:08:05.044214 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-3802122a-76e2-48d5-9418-ffe5b39cf43e req-2c304f78-c2ee-4547-bb69-23ee753f67c5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032773 Sep 08 14:08:05.045600 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 495/995] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:05.363353 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4fc65820-65c8-4e82-b649-a976f17c25b7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:05.364054 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4fc65820-65c8-4e82-b649-a976f17c25b7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:05.370124 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4fc65820-65c8-4e82-b649-a976f17c25b7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:05.370670 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4fc65820-65c8-4e82-b649-a976f17c25b7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:05.371200 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4fc65820-65c8-4e82-b649-a976f17c25b7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:05.371952 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4fc65820-65c8-4e82-b649-a976f17c25b7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:05.372642 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4fc65820-65c8-4e82-b649-a976f17c25b7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:05.373579 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4fc65820-65c8-4e82-b649-a976f17c25b7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:05.570803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4fc65820-65c8-4e82-b649-a976f17c25b7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:05.579817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4fc65820-65c8-4e82-b649-a976f17c25b7 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.220293 Sep 08 14:08:05.580488 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 501/996] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:05 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:06.604668 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-03383013-7e18-480b-90c1-c8aa62b1f99f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:06.605444 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-03383013-7e18-480b-90c1-c8aa62b1f99f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:06.614698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-03383013-7e18-480b-90c1-c8aa62b1f99f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:06.615612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-03383013-7e18-480b-90c1-c8aa62b1f99f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:06.616121 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-03383013-7e18-480b-90c1-c8aa62b1f99f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:06.616957 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-03383013-7e18-480b-90c1-c8aa62b1f99f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:06.617500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-03383013-7e18-480b-90c1-c8aa62b1f99f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:06.618152 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-03383013-7e18-480b-90c1-c8aa62b1f99f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:06.761274 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-03383013-7e18-480b-90c1-c8aa62b1f99f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:06.765560 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:06.770463 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-03383013-7e18-480b-90c1-c8aa62b1f99f tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1313 microversion: 2.1 time: 0.170202 Sep 08 14:08:06.771090 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 496/997] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:06 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:07.793888 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f223032c-972e-49f2-8446-b200466fc429 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:07.794564 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f223032c-972e-49f2-8446-b200466fc429 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:07.802743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f223032c-972e-49f2-8446-b200466fc429 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.803522 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f223032c-972e-49f2-8446-b200466fc429 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.804057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f223032c-972e-49f2-8446-b200466fc429 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:07.805070 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f223032c-972e-49f2-8446-b200466fc429 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.806184 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f223032c-972e-49f2-8446-b200466fc429 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.806762 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f223032c-972e-49f2-8446-b200466fc429 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:07.945179 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f223032c-972e-49f2-8446-b200466fc429 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:07.953829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f223032c-972e-49f2-8446-b200466fc429 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1496 microversion: 2.1 time: 0.164206 Sep 08 14:08:07.954400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 502/998] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:07 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1496 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:08.936776 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3a564580-4fed-44b5-8258-05f71edd3677 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:08.937450 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3a564580-4fed-44b5-8258-05f71edd3677 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:08.945039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a564580-4fed-44b5-8258-05f71edd3677 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:08.945743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a564580-4fed-44b5-8258-05f71edd3677 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:08.946184 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a564580-4fed-44b5-8258-05f71edd3677 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:08.946878 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a564580-4fed-44b5-8258-05f71edd3677 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:08.947358 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a564580-4fed-44b5-8258-05f71edd3677 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:08.947847 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3a564580-4fed-44b5-8258-05f71edd3677 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:08.975066 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3a564580-4fed-44b5-8258-05f71edd3677 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:08:09.255147 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3a564580-4fed-44b5-8258-05f71edd3677 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "DELETE /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 204 len: 0 microversion: 2.1 time: 0.322347 Sep 08 14:08:09.255968 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 497/999] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:08:08 2022] DELETE /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:08:09.265856 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-efb1e4b6-7799-4481-b1ce-f80676441bf2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:09.267943 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-efb1e4b6-7799-4481-b1ce-f80676441bf2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:09.275494 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-efb1e4b6-7799-4481-b1ce-f80676441bf2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:09.276031 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-efb1e4b6-7799-4481-b1ce-f80676441bf2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:09.276709 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-efb1e4b6-7799-4481-b1ce-f80676441bf2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.277449 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-efb1e4b6-7799-4481-b1ce-f80676441bf2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:09.277905 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-efb1e4b6-7799-4481-b1ce-f80676441bf2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:09.278546 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-efb1e4b6-7799-4481-b1ce-f80676441bf2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.415663 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-efb1e4b6-7799-4481-b1ce-f80676441bf2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:09.425266 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-efb1e4b6-7799-4481-b1ce-f80676441bf2 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1502 microversion: 2.1 time: 0.164823 Sep 08 14:08:09.426179 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 503/1000] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:09 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:10.450219 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-47e39499-643f-4509-922f-80b9632aefca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:10.451024 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-47e39499-643f-4509-922f-80b9632aefca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:10.457607 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47e39499-643f-4509-922f-80b9632aefca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:10.458151 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47e39499-643f-4509-922f-80b9632aefca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:10.458588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47e39499-643f-4509-922f-80b9632aefca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:10.459318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47e39499-643f-4509-922f-80b9632aefca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:10.459789 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47e39499-643f-4509-922f-80b9632aefca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:10.460206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47e39499-643f-4509-922f-80b9632aefca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:10.627822 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-47e39499-643f-4509-922f-80b9632aefca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:10.636427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-47e39499-643f-4509-922f-80b9632aefca tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1502 microversion: 2.1 time: 0.190353 Sep 08 14:08:10.636992 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 498/1001] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:10 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:11.665314 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d19dfc60-6f3b-44bf-ad0e-cc570e35b111 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:11.665314 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d19dfc60-6f3b-44bf-ad0e-cc570e35b111 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:11.671938 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d19dfc60-6f3b-44bf-ad0e-cc570e35b111 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.672435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d19dfc60-6f3b-44bf-ad0e-cc570e35b111 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.672933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d19dfc60-6f3b-44bf-ad0e-cc570e35b111 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.673643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d19dfc60-6f3b-44bf-ad0e-cc570e35b111 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.674109 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d19dfc60-6f3b-44bf-ad0e-cc570e35b111 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.674533 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-d19dfc60-6f3b-44bf-ad0e-cc570e35b111 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.681001 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:11.694439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-977741a6-114f-4d60-9770-e085d18c248e req-8b217c31-dc03-45d6-ac65-efe923b05750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b8dfaa-616e-4d51-8ae4-1ad1040c69f4", "name": "network-vif-deleted", "tag": "29b6607d-96a3-4a06-9906-46a22f0a210b"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:11.707904 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-977741a6-114f-4d60-9770-e085d18c248e req-8b217c31-dc03-45d6-ac65-efe923b05750 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.708392 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-977741a6-114f-4d60-9770-e085d18c248e req-8b217c31-dc03-45d6-ac65-efe923b05750 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.708826 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-977741a6-114f-4d60-9770-e085d18c248e req-8b217c31-dc03-45d6-ac65-efe923b05750 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.721494 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-977741a6-114f-4d60-9770-e085d18c248e req-8b217c31-dc03-45d6-ac65-efe923b05750 service nova] Creating event network-vif-deleted:29b6607d-96a3-4a06-9906-46a22f0a210b for instance 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 on hv-cinder-84773 Sep 08 14:08:11.726396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-977741a6-114f-4d60-9770-e085d18c248e req-8b217c31-dc03-45d6-ac65-efe923b05750 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036165 Sep 08 14:08:11.727239 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 499/1002] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:08:11.753442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d19dfc60-6f3b-44bf-ad0e-cc570e35b111 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:11.761737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d19dfc60-6f3b-44bf-ad0e-cc570e35b111 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1460 microversion: 2.1 time: 0.104202 Sep 08 14:08:11.774391 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 504/1003] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:11 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1460 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:12.790778 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:12.791474 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:12.805690 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.806186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.811645 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.811645 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.811645 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.811645 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.840367 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.840902 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.841341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.842236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lazy-loading 'fault' on Instance uuid 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:08:12.905473 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4cc11524fe542c5a5361b3630e6d3a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefb0f83ce4447cc9223c383a256676a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:12.915999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-598dbbf3-6ef2-4c58-ad82-7c8486a34b0e tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 200 len: 1303 microversion: 2.1 time: 0.129843 Sep 08 14:08:12.919621 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 500/1004] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:12 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 1303 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:12.928764 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-6577b5e0-7c2c-4b91-87b9-6597c5371c77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:12.931023 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-6577b5e0-7c2c-4b91-87b9-6597c5371c77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:12.939188 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6577b5e0-7c2c-4b91-87b9-6597c5371c77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.939893 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6577b5e0-7c2c-4b91-87b9-6597c5371c77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.940331 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6577b5e0-7c2c-4b91-87b9-6597c5371c77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.941032 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6577b5e0-7c2c-4b91-87b9-6597c5371c77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.941477 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6577b5e0-7c2c-4b91-87b9-6597c5371c77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.942066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-6577b5e0-7c2c-4b91-87b9-6597c5371c77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.977669 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-6577b5e0-7c2c-4b91-87b9-6597c5371c77 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052860 Sep 08 14:08:12.978938 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 505/1005] 10.222.0.91 () {60 vars in 1343 bytes} [Thu Sep 8 14:08:12 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:13.053028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4a0243c6-079b-4077-9ac5-73550be9e287 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:13.053523 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4a0243c6-079b-4077-9ac5-73550be9e287 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:13.060652 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a0243c6-079b-4077-9ac5-73550be9e287 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:13.061199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a0243c6-079b-4077-9ac5-73550be9e287 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:13.061628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a0243c6-079b-4077-9ac5-73550be9e287 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:13.062649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a0243c6-079b-4077-9ac5-73550be9e287 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:13.063272 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a0243c6-079b-4077-9ac5-73550be9e287 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:13.063796 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a0243c6-079b-4077-9ac5-73550be9e287 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:13.089158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4a0243c6-079b-4077-9ac5-73550be9e287 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:08:13.423787 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4a0243c6-079b-4077-9ac5-73550be9e287 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 204 len: 0 microversion: 2.20 time: 0.374324 Sep 08 14:08:13.424417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 501/1006] 10.222.0.91 () {60 vars in 1280 bytes} [Thu Sep 8 14:08:13 2022] DELETE /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 14:08:13.433335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:13.433945 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:13.440666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:13.441151 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:13.441583 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:13.442275 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:13.442729 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:13.443179 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:13.575859 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:13.583822 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:13.585275 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:13.586444 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-70b4fa46-e832-41cf-8f73-ddf7a6fccb75 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.157481 Sep 08 14:08:13.587104 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 506/1007] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:13 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:13.942978 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:13.943717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] [instance: 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:13.950305 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:13.951435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:13.951883 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:13.952584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:13.953079 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:13.953505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:13.967158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] HTTP exception thrown: Instance 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 could not be found. Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Request method failure captured: Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 HTTP/1.1 Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfcLnHCMmkbXiwaNlYY44RkUctgCIg4rzIk_YHpAw0_0VNplNvReh04aLxrEyhvz4qI_-6_yfJVamzjbXH0pt4Uz0XKPR5RFMLs3Ix5DZc7Qf4xGJzDYD3iAKT3TWEEuhiI_dL99I4xPxvoqyB4wA-6seK1q7uKmB71QSbbfoA4g6lk Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: fefb0f83ce4447cc9223c383a256676a Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-VolumesActionsTest-1103795049 Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:08:13.968808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/fefb0f83ce4447cc9223c383a256676a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/fefb0f83ce4447cc9223c383a256676a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_fefb0f83ce4447cc9223c383a256676a", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/fefb0f83ce4447cc9223c383a256676a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-VolumesActionsTest-1103795049 Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: fefb0f83ce4447cc9223c383a256676a Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-VolumesActionsTest-1103795049 Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-VolumesActionsTest-1103795049-project Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: b4cc11524fe542c5a5361b3630e6d3a6 Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-VolumesActionsTest-1103795049-project Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 could not be found. Sep 08 14:08:13.970969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '73b8dfaa-616e-4d51-8ae4-1ad1040c69f4'} Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 could not be found. Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:13.972083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 could not be found. Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 could not be found. Sep 08 14:08:13.973887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:13.975126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] Returning 404 to user: Instance 73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:13.975126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-fad0fc84-ed89-4496-97d8-18a23ee591a0 tempest-VolumesActionsTest-1103795049 tempest-VolumesActionsTest-1103795049-project] 10.222.0.91 "GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4" status: 404 len: 111 microversion: 2.1 time: 0.031574 Sep 08 14:08:13.975126 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 502/1008] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:13 2022] GET /compute/v2.1/servers/73b8dfaa-616e-4d51-8ae4-1ad1040c69f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:14.613562 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:14.614168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:14.621416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:14.621416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:14.621592 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:14.622209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:14.623166 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:14.623592 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:14.763690 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:14.772165 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:14.773872 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:14.776732 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9da25ce9-4840-4174-a003-9c52d5223d89 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.165475 Sep 08 14:08:14.776732 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 507/1009] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:14 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:15.802437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:15.803057 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:15.810251 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:15.810656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:15.811124 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:15.811843 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:15.812977 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:15.812977 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:15.980163 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:15.992393 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:15.994195 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:15.996280 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-42ea0c0d-df38-46a7-b359-8cd58f14279c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1723 microversion: 2.20 time: 0.198891 Sep 08 14:08:16.014917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 503/1010] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:15 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:16.357397 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-1943ff4b-4009-4534-aa7d-66baa4e0bd9e req-b9cd1b46-2f16-4685-b60e-ebaeef210c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94c00a6-d72c-4474-9ac0-8fedb2e32fe2", "name": "network-vif-deleted", "tag": "d3992e28-2f02-43b3-9041-87bf6fafeffe"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:16.372954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-1943ff4b-4009-4534-aa7d-66baa4e0bd9e req-b9cd1b46-2f16-4685-b60e-ebaeef210c9e service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:16.373568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-1943ff4b-4009-4534-aa7d-66baa4e0bd9e req-b9cd1b46-2f16-4685-b60e-ebaeef210c9e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:16.374040 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-1943ff4b-4009-4534-aa7d-66baa4e0bd9e req-b9cd1b46-2f16-4685-b60e-ebaeef210c9e service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:16.386277 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-1943ff4b-4009-4534-aa7d-66baa4e0bd9e req-b9cd1b46-2f16-4685-b60e-ebaeef210c9e service nova] Creating event network-vif-deleted:d3992e28-2f02-43b3-9041-87bf6fafeffe for instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 on hv-cinder-84773 Sep 08 14:08:16.393687 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-1943ff4b-4009-4534-aa7d-66baa4e0bd9e req-b9cd1b46-2f16-4685-b60e-ebaeef210c9e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039553 Sep 08 14:08:16.394775 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 508/1011] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:17.033360 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:17.033997 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:17.050856 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:17.056072 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:17.064377 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:17.064377 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:17.064377 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:17.064377 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:17.172510 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:17.182301 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:17.184061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:17.185459 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f1cb3c21-3d6a-4cff-912f-4b445dfa9d35 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1655 microversion: 2.20 time: 0.157313 Sep 08 14:08:17.186500 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 504/1012] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:17 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:18.217466 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:18.218216 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:18.224643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:18.225119 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:18.225549 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:18.226238 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:18.226775 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:18.227332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:18.306227 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:18.320448 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:18.331102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48bf6dab289545bb80182c8904c05d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9448ca7c8234f74b24c8f6710a0ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:18.332363 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-001831c4-75ba-438b-8c3f-085c8d9cf2b8 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 200 len: 1655 microversion: 2.20 time: 0.119871 Sep 08 14:08:18.332929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 509/1013] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:18 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 1655 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:08:19.358417 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:19.359541 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:19.368148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:19.368640 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:19.369075 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:19.369838 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:19.376552 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:19.376552 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:19.388867 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] HTTP exception thrown: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Request method failure captured: Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 HTTP/1.1 Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfXJ5WP7P5luFw8v6lGcMvripLPXxFA2OYW7phQDyBxZXZ8bgHJGvPsJMNlRoWctBWZhpTI-cZ_vbjGlQxuQIxrUCilA05GJqjHbxn6RBDJZgtZW22ASMfF-Newb_4L8zNKPoj45Z7gDysZfBUpP2jR326gFGBFpruHHkOq1Du6Q5UQ Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:08:19.390425 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_a9448ca7c8234f74b24c8f6710a0ef5c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 48bf6dab289545bb80182c8904c05d6c Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:19.392266 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'b94c00a6-d72c-4474-9ac0-8fedb2e32fe2'} Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:19.393176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:19.394628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:19.396937 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Returning 404 to user: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:19.398047 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-181b25f3-3057-4526-98dd-61ac602a8b8e tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 404 len: 111 microversion: 2.20 time: 0.044401 Sep 08 14:08:19.402098 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 505/1014] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:19 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:08:19.407379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c9235114-01cc-4061-8430-e650540c0ebe tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '.version_select at 0x7f52003f73a0>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:19.412326 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c9235114-01cc-4061-8430-e650540c0ebe tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [2093eaf2-67f1-4907-8636-899a38211495] AMQP server on 10.222.0.91:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 14:08:20.422200 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO oslo.messaging._drivers.impl_rabbit [None req-c9235114-01cc-4061-8430-e650540c0ebe tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [2093eaf2-67f1-4907-8636-899a38211495] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 53310. Sep 08 14:08:20.511675 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c9235114-01cc-4061-8430-e650540c0ebe tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-281384556" status: 204 len: 0 microversion: 2.20 time: 1.108299 Sep 08 14:08:20.521645 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 510/1015] 10.222.0.91 () {60 vars in 1259 bytes} [Thu Sep 8 14:08:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-281384556 => generated 0 bytes in 1111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 14:08:23.073205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:23.074437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:23.081786 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:23.082323 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:23.082999 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:23.083736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:23.084356 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:23.084697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:23.100765 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] HTTP exception thrown: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Request method failure captured: Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: DELETE /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 HTTP/1.1 Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfXJ5WP7P5luFw8v6lGcMvripLPXxFA2OYW7phQDyBxZXZ8bgHJGvPsJMNlRoWctBWZhpTI-cZ_vbjGlQxuQIxrUCilA05GJqjHbxn6RBDJZgtZW22ASMfF-Newb_4L8zNKPoj45Z7gDysZfBUpP2jR326gFGBFpruHHkOq1Du6Q5UQ Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:08:23.102616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_a9448ca7c8234f74b24c8f6710a0ef5c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 48bf6dab289545bb80182c8904c05d6c Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:23.104439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'b94c00a6-d72c-4474-9ac0-8fedb2e32fe2'} Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:23.105375 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:23.108385 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:23.110183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Returning 404 to user: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:23.110183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3e9ac480-f228-4ca8-95d6-b9225c5171ce tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 404 len: 111 microversion: 2.20 time: 0.035184 Sep 08 14:08:23.110183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 506/1016] 10.222.0.91 () {60 vars in 1280 bytes} [Thu Sep 8 14:08:23 2022] DELETE /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:08:23.117152 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:23.118066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: b94c00a6-d72c-4474-9ac0-8fedb2e32fe2] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:23.127085 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:23.127779 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:23.128349 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:23.129205 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:23.129780 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:23.130214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:23.145818 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] HTTP exception thrown: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Request method failure captured: Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 HTTP/1.1 Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfXJ5WP7P5luFw8v6lGcMvripLPXxFA2OYW7phQDyBxZXZ8bgHJGvPsJMNlRoWctBWZhpTI-cZ_vbjGlQxuQIxrUCilA05GJqjHbxn6RBDJZgtZW22ASMfF-Newb_4L8zNKPoj45Z7gDysZfBUpP2jR326gFGBFpruHHkOq1Du6Q5UQ Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:08:23.147862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_a9448ca7c8234f74b24c8f6710a0ef5c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 48bf6dab289545bb80182c8904c05d6c Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:23.149417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': 'b94c00a6-d72c-4474-9ac0-8fedb2e32fe2'} Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:23.150302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. Sep 08 14:08:23.151900 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:23.153980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Returning 404 to user: Instance b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:23.153980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-55a61a3a-909b-461e-b647-4c80d25bdf9c tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2" status: 404 len: 111 microversion: 2.20 time: 0.036437 Sep 08 14:08:23.154178 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 511/1017] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:23 2022] GET /compute/v2.1/servers/b94c00a6-d72c-4474-9ac0-8fedb2e32fe2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:08:24.800437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:24.800437 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:24.804803 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:24.805235 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:24.806478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:24.806616 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:24.806994 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:24.807424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:24.822506 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] HTTP exception thrown: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Request method failure captured: Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: DELETE /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd HTTP/1.1 Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfXJ5WP7P5luFw8v6lGcMvripLPXxFA2OYW7phQDyBxZXZ8bgHJGvPsJMNlRoWctBWZhpTI-cZ_vbjGlQxuQIxrUCilA05GJqjHbxn6RBDJZgtZW22ASMfF-Newb_4L8zNKPoj45Z7gDysZfBUpP2jR326gFGBFpruHHkOq1Du6Q5UQ Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:08:24.830352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_a9448ca7c8234f74b24c8f6710a0ef5c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 48bf6dab289545bb80182c8904c05d6c Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:08:24.832010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '99ba16ca-2c31-48e8-853e-416c2c3bf1fd'} Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:24.832891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:08:24.834363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:24.835909 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Returning 404 to user: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:24.835909 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a942f725-9802-4b1a-8b78-35e2501ed5f7 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "DELETE /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 404 len: 111 microversion: 2.20 time: 0.033252 Sep 08 14:08:24.835909 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 507/1018] 10.222.0.91 () {60 vars in 1280 bytes} [Thu Sep 8 14:08:24 2022] DELETE /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:08:24.840671 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:24.842046 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] [instance: 99ba16ca-2c31-48e8-853e-416c2c3bf1fd] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:24.848200 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:08:24.848450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Thu Sep 8 14:08:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd (ip 10.222.0.91) !!! Sep 08 14:08:24.855350 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:24.870455 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:24.870455 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:24.870455 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:24.870455 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:24.870909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:24.874336 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] HTTP exception thrown: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Request method failure captured: Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd HTTP/1.1 Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfXJ5WP7P5luFw8v6lGcMvripLPXxFA2OYW7phQDyBxZXZ8bgHJGvPsJMNlRoWctBWZhpTI-cZ_vbjGlQxuQIxrUCilA05GJqjHbxn6RBDJZgtZW22ASMfF-Newb_4L8zNKPoj45Z7gDysZfBUpP2jR326gFGBFpruHHkOq1Du6Q5UQ Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:08:24.876027 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_a9448ca7c8234f74b24c8f6710a0ef5c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/a9448ca7c8234f74b24c8f6710a0ef5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: a9448ca7c8234f74b24c8f6710a0ef5c Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-237840895 Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 48bf6dab289545bb80182c8904c05d6c Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-237840895-project Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:08:24.877824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '99ba16ca-2c31-48e8-853e-416c2c3bf1fd'} Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:24.878743 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. Sep 08 14:08:24.880442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:24.881619 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] Returning 404 to user: Instance 99ba16ca-2c31-48e8-853e-416c2c3bf1fd could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:24.881619 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-10f1dfa8-5241-4be4-8e05-605afa9787e2 tempest-AttachVolumeShelveTestJSON-237840895 tempest-AttachVolumeShelveTestJSON-237840895-project] 10.222.0.91 "GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd" status: 404 len: 111 microversion: 2.20 time: 0.043002 Sep 08 14:08:24.881619 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 512/1019] 10.222.0.91 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:24 2022] GET /compute/v2.1/servers/99ba16ca-2c31-48e8-853e-416c2c3bf1fd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:08:33.478448 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8cb9dd5b-5cf8-494d-a4c8-35d6edbb2d37 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Action: 'create', calling method: .version_select at 0x7f520003e550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-341557240"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:34.497497 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8cb9dd5b-5cf8-494d-a4c8-35d6edbb2d37 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.347185 Sep 08 14:08:34.498371 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 508/1020] 10.222.0.91 () {60 vars in 1155 bytes} [Thu Sep 8 14:08:33 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1349 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 14:08:34.515352 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-a3e2a864-048a-45f2-8840-959b63c0b2b2 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f52001a11f0>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:34.571566 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-a3e2a864-048a-45f2-8840-959b63c0b2b2 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60" status: 200 len: 344 microversion: 2.1 time: 0.062628 Sep 08 14:08:34.572431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 513/1021] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 14:08:34 2022] GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:35.582995 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:35.584080 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:35.588628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b4d7466d-5e39-4fef-9c34-d51513077939 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f51fbf77ee0>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:35.637477 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b4d7466d-5e39-4fef-9c34-d51513077939 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60" status: 200 len: 344 microversion: 2.1 time: 0.055177 Sep 08 14:08:35.638173 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 509/1022] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 14:08:35 2022] GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:36.650306 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:36.651793 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=35 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:36.656767 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c182998e-c700-47f6-8df2-0e8ab6e5bd22 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f5200060b80>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:36.740515 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c182998e-c700-47f6-8df2-0e8ab6e5bd22 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60" status: 200 len: 345 microversion: 2.1 time: 0.091139 Sep 08 14:08:36.741290 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 514/1023] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 14:08:36 2022] GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 => generated 345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:36.761136 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b23bcefa-9ceb-4d44-958a-ff55498bf924 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Action: 'create', calling method: .version_select at 0x7f51fbfee820>, body: {"snapshot": {"volume_id": "b4381f68-fbf1-4186-a29d-1e860cb29b60", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-45547298"}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:37.368955 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b23bcefa-9ceb-4d44-958a-ff55498bf924 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.614245 Sep 08 14:08:37.369761 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 510/1024] 10.222.0.91 () {60 vars in 1162 bytes} [Thu Sep 8 14:08:36 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:37.384284 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-0e32890e-792c-4b38-8f17-70aef1ce2f6e tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f51fbffddc0>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:37.429733 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-0e32890e-792c-4b38-8f17-70aef1ce2f6e tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972" status: 200 len: 285 microversion: 2.1 time: 0.051064 Sep 08 14:08:37.430973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 515/1025] 10.222.0.91 () {58 vars in 1251 bytes} [Thu Sep 8 14:08:37 2022] GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972 => generated 285 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:37.442617 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-89cc538d-0534-4b22-bc8c-b2572a6cf0f9 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f520003e8b0>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:37.485825 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-89cc538d-0534-4b22-bc8c-b2572a6cf0f9 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.046779 Sep 08 14:08:37.486733 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 511/1026] 10.222.0.91 () {58 vars in 1140 bytes} [Thu Sep 8 14:08:37 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:37.502110 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ec03fd94-2f33-4c86-89fd-1dd658aa01ae tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f51fbda4ee0>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:37.556007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ec03fd94-2f33-4c86-89fd-1dd658aa01ae tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972" status: 200 len: 285 microversion: 2.1 time: 0.061111 Sep 08 14:08:37.557262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 516/1027] 10.222.0.91 () {58 vars in 1251 bytes} [Thu Sep 8 14:08:37 2022] GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972 => generated 285 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:08:38.571937 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f2827979-6f9f-4314-bd5b-1849ce650cc1 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f51fbe11c10>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:38.603086 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f2827979-6f9f-4314-bd5b-1849ce650cc1 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972" status: 200 len: 285 microversion: 2.1 time: 0.037066 Sep 08 14:08:38.604030 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 512/1028] 10.222.0.91 () {58 vars in 1251 bytes} [Thu Sep 8 14:08:38 2022] GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972 => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:39.623765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7b0c7730-752e-4a32-a9dc-2f5f906f4ac7 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f5200060c10>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:39.668827 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7b0c7730-752e-4a32-a9dc-2f5f906f4ac7 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972" status: 200 len: 285 microversion: 2.1 time: 0.054540 Sep 08 14:08:39.669835 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 517/1029] 10.222.0.91 () {58 vars in 1251 bytes} [Thu Sep 8 14:08:39 2022] GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972 => generated 285 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:40.682917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3c4bf35b-2a21-4636-883e-cd93c86c69e4 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f520003ed30>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:40.715594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3c4bf35b-2a21-4636-883e-cd93c86c69e4 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972" status: 200 len: 285 microversion: 2.1 time: 0.036894 Sep 08 14:08:40.720891 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 513/1030] 10.222.0.91 () {58 vars in 1251 bytes} [Thu Sep 8 14:08:40 2022] GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972 => generated 285 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:41.728987 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-474e6f53-1ec6-4af1-a828-a066a5f9f536 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f52000604c0>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:41.759652 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-474e6f53-1ec6-4af1-a828-a066a5f9f536 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972" status: 200 len: 286 microversion: 2.1 time: 0.034956 Sep 08 14:08:41.760356 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 518/1031] 10.222.0.91 () {58 vars in 1251 bytes} [Thu Sep 8 14:08:41 2022] GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:41.772430 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-878927ac-4131-4d8d-95e3-b21d391a3560 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f51fbe108b0>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:41.924473 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-878927ac-4131-4d8d-95e3-b21d391a3560 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "DELETE /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972" status: 202 len: 0 microversion: 2.1 time: 0.156571 Sep 08 14:08:41.925569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 514/1032] 10.222.0.91 () {58 vars in 1254 bytes} [Thu Sep 8 14:08:41 2022] DELETE /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:08:41.934306 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1d51f5ab-0719-4440-992c-1bcb368d253a tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f5200060790>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:41.966689 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1d51f5ab-0719-4440-992c-1bcb368d253a tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972" status: 200 len: 285 microversion: 2.1 time: 0.036752 Sep 08 14:08:41.967217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 519/1033] 10.222.0.91 () {58 vars in 1251 bytes} [Thu Sep 8 14:08:41 2022] GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:42.980285 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f67d1b45-2975-43ec-9613-fae4078c2823 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f51fbe2de50>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:43.008517 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-f67d1b45-2975-43ec-9613-fae4078c2823 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] HTTP exception thrown: Snapshot b7cc85de-fb4f-4905-8fb0-891b62182972 could not be found. Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f67d1b45-2975-43ec-9613-fae4078c2823 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Request method failure captured: Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972 HTTP/1.1 Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfdhiroDArkptD6RslUAP7lWHNgJfnm0kID4Ari5_LsmOA3Z_mLU7-lxEB9SB0VWB7tmYg2hHP7O99S-zhWHrrHxrJE4gFAdQgqVlT9i6WDpG3Pz2NNyRG8W8T0KL2IjrPQsvae9JfrZxkeP9t4ZDPmRBk15VeXaHqWRu-tbvSsKz7Y Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: ea4a774193494f7eab5047a98a285a7c Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:08:43.010816 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ea4a774193494f7eab5047a98a285a7c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: ea4a774193494f7eab5047a98a285a7c Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-VolumesSnapshotsTestJSON-967676087-project Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 206c96a9fff349bdbe63ff045cfe74cf Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-VolumesSnapshotsTestJSON-967676087-project Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Snapshot b7cc85de-fb4f-4905-8fb0-891b62182972 could not be found. Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'b7cc85de-fb4f-4905-8fb0-891b62182972'} Sep 08 14:08:43.012947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b7cc85de-fb4f-4905-8fb0-891b62182972 could not be found. (HTTP 404) (Request-ID: req-02f53cfc-ba6b-40f3-bdff-000d18357d07) Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:43.014028 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:08:43.015452 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b7cc85de-fb4f-4905-8fb0-891b62182972 could not be found. Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 08 14:08:43.016594 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b7cc85de-fb4f-4905-8fb0-891b62182972 could not be found. Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b7cc85de-fb4f-4905-8fb0-891b62182972 could not be found. Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f67d1b45-2975-43ec-9613-fae4078c2823 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Returning 404 to user: Snapshot b7cc85de-fb4f-4905-8fb0-891b62182972 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:43.017894 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f67d1b45-2975-43ec-9613-fae4078c2823 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972" status: 404 len: 111 microversion: 2.1 time: 0.036956 Sep 08 14:08:43.018870 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 515/1034] 10.222.0.91 () {58 vars in 1251 bytes} [Thu Sep 8 14:08:42 2022] GET /compute/v2.1/os-snapshots/b7cc85de-fb4f-4905-8fb0-891b62182972 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:43.022825 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-071dfafa-433f-48e5-808e-bcef4ef8b40c tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f51fbca4820>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:43.215898 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1602325803", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "networks": [{"uuid": "98e1279e-79e8-4a3f-8500-f2fed10455c8"}]}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:43.270305 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.network.neutron [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] validate_networks() for [('98e1279e-79e8-4a3f-8500-f2fed10455c8', None, None, None, None, None)] {{(pid=133058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:08:43.281515 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-071dfafa-433f-48e5-808e-bcef4ef8b40c tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60" status: 202 len: 0 microversion: 2.1 time: 0.263651 Sep 08 14:08:43.282122 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 520/1035] 10.222.0.91 () {58 vars in 1248 bytes} [Thu Sep 8 14:08:43 2022] DELETE /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:08:43.290165 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-054ac613-af7a-467f-8940-c292a986021f tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f5200060790>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:43.341239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-054ac613-af7a-467f-8940-c292a986021f tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60" status: 200 len: 344 microversion: 2.1 time: 0.054823 Sep 08 14:08:43.348523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 521/1036] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 14:08:43 2022] GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:08:43.686143 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Flavor limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:08:43.687529 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Image limits 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:08:43.688692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Flavor pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:08:43.689534 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Image pref 0:0:0 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:08:43.690764 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.virt.hardware [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:08:43.705180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:43.705890 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:43.707479 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:43.708319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:43.708860 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:43.709428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:43.729401 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Getting quotas for project 736f37b101ed43369000a5ba9d93e90f. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:08:43.734010 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Getting quotas for user 4ac5fd494df14ee1b0faf745dcc8c1e3 and project 736f37b101ed43369000a5ba9d93e90f. Resources: {'cores', 'ram', 'instances'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:08:43.750557 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Going to run 1 instances... {{(pid=133058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:08:43.753704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:08:43.897428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5f7feb8a-7a20-4a8f-9884-1c33b1a8d2d8 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685411 Sep 08 14:08:43.898227 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 516/1037] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:08:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:08:43.914210 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-d961c40b-ce06-4467-9fbf-b3781d5682f1 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:43.914834 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-d961c40b-ce06-4467-9fbf-b3781d5682f1 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:43.988778 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-d961c40b-ce06-4467-9fbf-b3781d5682f1 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:43.998741 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-d961c40b-ce06-4467-9fbf-b3781d5682f1 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1219 microversion: 2.1 time: 0.092039 Sep 08 14:08:43.998741 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 522/1038] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:43 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:44.358767 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1bb82e02-60b6-41ec-b00b-4293fef84a89 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f520003e430>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:44.391390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-1bb82e02-60b6-41ec-b00b-4293fef84a89 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] HTTP exception thrown: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1bb82e02-60b6-41ec-b00b-4293fef84a89 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Request method failure captured: Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 HTTP/1.1 Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfdhiroDArkptD6RslUAP7lWHNgJfnm0kID4Ari5_LsmOA3Z_mLU7-lxEB9SB0VWB7tmYg2hHP7O99S-zhWHrrHxrJE4gFAdQgqVlT9i6WDpG3Pz2NNyRG8W8T0KL2IjrPQsvae9JfrZxkeP9t4ZDPmRBk15VeXaHqWRu-tbvSsKz7Y Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: ea4a774193494f7eab5047a98a285a7c Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:08:44.393609 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ea4a774193494f7eab5047a98a285a7c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: ea4a774193494f7eab5047a98a285a7c Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-VolumesSnapshotsTestJSON-967676087-project Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 206c96a9fff349bdbe63ff045cfe74cf Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-VolumesSnapshotsTestJSON-967676087-project Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'b4381f68-fbf1-4186-a29d-1e860cb29b60'} Sep 08 14:08:44.395273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. (HTTP 404) (Request-ID: req-07d7551b-22b3-4cfd-9787-193cc90447d8) Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:44.396429 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:08:44.398118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 14:08:44.399505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1bb82e02-60b6-41ec-b00b-4293fef84a89 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Returning 404 to user: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1bb82e02-60b6-41ec-b00b-4293fef84a89 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60" status: 404 len: 109 microversion: 2.1 time: 0.042606 Sep 08 14:08:44.400854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 517/1039] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 14:08:44 2022] GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:44.413621 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ba9bde7a-e971-41ff-ae75-59834df434f8 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f51fbca4e50>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:44.442456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-ba9bde7a-e971-41ff-ae75-59834df434f8 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] HTTP exception thrown: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ba9bde7a-e971-41ff-ae75-59834df434f8 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Request method failure captured: Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: DELETE /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 HTTP/1.1 Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfdhiroDArkptD6RslUAP7lWHNgJfnm0kID4Ari5_LsmOA3Z_mLU7-lxEB9SB0VWB7tmYg2hHP7O99S-zhWHrrHxrJE4gFAdQgqVlT9i6WDpG3Pz2NNyRG8W8T0KL2IjrPQsvae9JfrZxkeP9t4ZDPmRBk15VeXaHqWRu-tbvSsKz7Y Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: ea4a774193494f7eab5047a98a285a7c Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:08:44.442973 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ea4a774193494f7eab5047a98a285a7c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: ea4a774193494f7eab5047a98a285a7c Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-VolumesSnapshotsTestJSON-967676087-project Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 206c96a9fff349bdbe63ff045cfe74cf Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-967676087-project Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': 'b4381f68-fbf1-4186-a29d-1e860cb29b60'} Sep 08 14:08:44.444553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. (HTTP 404) (Request-ID: req-c90e1e51-adc3-4185-b24f-413733143ea9) Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:44.445510 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:08:44.446866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 14:08:44.448236 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ba9bde7a-e971-41ff-ae75-59834df434f8 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Returning 404 to user: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ba9bde7a-e971-41ff-ae75-59834df434f8 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60" status: 404 len: 109 microversion: 2.1 time: 0.038010 Sep 08 14:08:44.450293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 523/1040] 10.222.0.91 () {58 vars in 1248 bytes} [Thu Sep 8 14:08:44 2022] DELETE /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:44.464700 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c66130bc-c19e-44c5-9ca4-b9c4691127b2 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Calling method '.version_select at 0x7f520003edc0>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:44.502737 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-c66130bc-c19e-44c5-9ca4-b9c4691127b2 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] HTTP exception thrown: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c66130bc-c19e-44c5-9ca4-b9c4691127b2 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Request method failure captured: Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 HTTP/1.1 Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfdhiroDArkptD6RslUAP7lWHNgJfnm0kID4Ari5_LsmOA3Z_mLU7-lxEB9SB0VWB7tmYg2hHP7O99S-zhWHrrHxrJE4gFAdQgqVlT9i6WDpG3Pz2NNyRG8W8T0KL2IjrPQsvae9JfrZxkeP9t4ZDPmRBk15VeXaHqWRu-tbvSsKz7Y Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: ea4a774193494f7eab5047a98a285a7c Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:08:44.505792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ea4a774193494f7eab5047a98a285a7c", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ea4a774193494f7eab5047a98a285a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: ea4a774193494f7eab5047a98a285a7c Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-967676087 Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-VolumesSnapshotsTestJSON-967676087-project Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 206c96a9fff349bdbe63ff045cfe74cf Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-VolumesSnapshotsTestJSON-967676087-project Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'b4381f68-fbf1-4186-a29d-1e860cb29b60'} Sep 08 14:08:44.507183 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. (HTTP 404) (Request-ID: req-4644bcea-3929-4d9f-965f-2c4f917f3809) Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:44.508033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:08:44.509304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 14:08:44.510849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c66130bc-c19e-44c5-9ca4-b9c4691127b2 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] Returning 404 to user: Volume b4381f68-fbf1-4186-a29d-1e860cb29b60 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c66130bc-c19e-44c5-9ca4-b9c4691127b2 tempest-VolumesSnapshotsTestJSON-967676087 tempest-VolumesSnapshotsTestJSON-967676087-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60" status: 404 len: 109 microversion: 2.1 time: 0.057125 Sep 08 14:08:44.513232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 518/1041] 10.222.0.91 () {58 vars in 1245 bytes} [Thu Sep 8 14:08:44 2022] GET /compute/v2.1/os-volumes/b4381f68-fbf1-4186-a29d-1e860cb29b60 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:08:45.020028 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-83695528-dc0d-4d60-a938-00fc8a5383ae tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:45.020647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-83695528-dc0d-4d60-a938-00fc8a5383ae tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:45.028156 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83695528-dc0d-4d60-a938-00fc8a5383ae tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:45.028320 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83695528-dc0d-4d60-a938-00fc8a5383ae tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:45.028650 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83695528-dc0d-4d60-a938-00fc8a5383ae tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:45.029355 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83695528-dc0d-4d60-a938-00fc8a5383ae tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:45.029810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83695528-dc0d-4d60-a938-00fc8a5383ae tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:45.030438 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83695528-dc0d-4d60-a938-00fc8a5383ae tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:45.115727 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-83695528-dc0d-4d60-a938-00fc8a5383ae tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:45.126278 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-83695528-dc0d-4d60-a938-00fc8a5383ae tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1223 microversion: 2.1 time: 0.109886 Sep 08 14:08:45.126855 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 524/1042] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:45 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1223 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:46.153872 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-47028425-cc18-4f68-88b1-771e54551f80 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:46.154632 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-47028425-cc18-4f68-88b1-771e54551f80 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:46.160611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47028425-cc18-4f68-88b1-771e54551f80 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:46.161112 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47028425-cc18-4f68-88b1-771e54551f80 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:46.161540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47028425-cc18-4f68-88b1-771e54551f80 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:46.162240 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47028425-cc18-4f68-88b1-771e54551f80 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:46.162694 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47028425-cc18-4f68-88b1-771e54551f80 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:46.163145 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-47028425-cc18-4f68-88b1-771e54551f80 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:46.234431 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-47028425-cc18-4f68-88b1-771e54551f80 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:46.242134 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-47028425-cc18-4f68-88b1-771e54551f80 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1271 microversion: 2.1 time: 0.094020 Sep 08 14:08:46.242711 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 519/1043] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:46 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:46.456558 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c81cd9fc-2a85-43f2-bb66-814353ff2f53 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:46.457670 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c81cd9fc-2a85-43f2-bb66-814353ff2f53 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:46.464960 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c81cd9fc-2a85-43f2-bb66-814353ff2f53 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:46.465450 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c81cd9fc-2a85-43f2-bb66-814353ff2f53 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:46.466106 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c81cd9fc-2a85-43f2-bb66-814353ff2f53 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:46.466803 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c81cd9fc-2a85-43f2-bb66-814353ff2f53 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:46.467307 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c81cd9fc-2a85-43f2-bb66-814353ff2f53 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:46.467735 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c81cd9fc-2a85-43f2-bb66-814353ff2f53 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:46.498530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-c81cd9fc-2a85-43f2-bb66-814353ff2f53 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lazy-loading 'flavor' on Instance uuid 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:08:46.824392 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c81cd9fc-2a85-43f2-bb66-814353ff2f53 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "POST /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b/action" status: 202 len: 0 microversion: 2.1 time: 0.371228 Sep 08 14:08:46.831611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 525/1044] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:08:46 2022] POST /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:08:46.841523 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4cb13a93-46c2-4118-9f8d-3b5b827b325f tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:46.842460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4cb13a93-46c2-4118-9f8d-3b5b827b325f tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:46.854085 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb13a93-46c2-4118-9f8d-3b5b827b325f tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:46.855470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb13a93-46c2-4118-9f8d-3b5b827b325f tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:46.860250 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb13a93-46c2-4118-9f8d-3b5b827b325f tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:46.860250 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb13a93-46c2-4118-9f8d-3b5b827b325f tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:46.860250 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb13a93-46c2-4118-9f8d-3b5b827b325f tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:46.860250 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb13a93-46c2-4118-9f8d-3b5b827b325f tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.004226 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4cb13a93-46c2-4118-9f8d-3b5b827b325f tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:47.015596 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4cb13a93-46c2-4118-9f8d-3b5b827b325f tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.184097 Sep 08 14:08:47.034035 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 520/1045] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:46 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:47.267728 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-57776692-6de4-4923-987d-e1cfc40b5d52 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:47.268521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-57776692-6de4-4923-987d-e1cfc40b5d52 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:47.278248 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57776692-6de4-4923-987d-e1cfc40b5d52 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:47.278747 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57776692-6de4-4923-987d-e1cfc40b5d52 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:47.279209 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57776692-6de4-4923-987d-e1cfc40b5d52 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.279926 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57776692-6de4-4923-987d-e1cfc40b5d52 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:47.280386 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57776692-6de4-4923-987d-e1cfc40b5d52 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:47.280807 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57776692-6de4-4923-987d-e1cfc40b5d52 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.393481 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-57776692-6de4-4923-987d-e1cfc40b5d52 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:47.401435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-57776692-6de4-4923-987d-e1cfc40b5d52 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1277 microversion: 2.1 time: 0.138479 Sep 08 14:08:47.417071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 526/1046] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:47 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:48.044743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-01fa5f50-716d-452a-ae25-87acfd9a6a76 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:48.046306 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-01fa5f50-716d-452a-ae25-87acfd9a6a76 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:48.055833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01fa5f50-716d-452a-ae25-87acfd9a6a76 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:48.055833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01fa5f50-716d-452a-ae25-87acfd9a6a76 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:48.055833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01fa5f50-716d-452a-ae25-87acfd9a6a76 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:48.056600 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01fa5f50-716d-452a-ae25-87acfd9a6a76 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:48.057249 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01fa5f50-716d-452a-ae25-87acfd9a6a76 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:48.058009 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-01fa5f50-716d-452a-ae25-87acfd9a6a76 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:48.344862 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-01fa5f50-716d-452a-ae25-87acfd9a6a76 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:48.352631 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-01fa5f50-716d-452a-ae25-87acfd9a6a76 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.313631 Sep 08 14:08:48.366229 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 521/1047] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:48 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:48.427105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8dddb8f4-3a74-43e5-9e33-8e346aca52b2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:48.428428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8dddb8f4-3a74-43e5-9e33-8e346aca52b2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:48.438361 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8dddb8f4-3a74-43e5-9e33-8e346aca52b2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:48.440918 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8dddb8f4-3a74-43e5-9e33-8e346aca52b2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:48.440918 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8dddb8f4-3a74-43e5-9e33-8e346aca52b2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:48.440918 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8dddb8f4-3a74-43e5-9e33-8e346aca52b2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:48.441862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8dddb8f4-3a74-43e5-9e33-8e346aca52b2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:48.442296 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8dddb8f4-3a74-43e5-9e33-8e346aca52b2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:48.646686 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8dddb8f4-3a74-43e5-9e33-8e346aca52b2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:48.659329 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8dddb8f4-3a74-43e5-9e33-8e346aca52b2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1319 microversion: 2.1 time: 0.236130 Sep 08 14:08:48.660667 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 527/1048] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:48 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:48.889039 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-f0e54244-fb99-4a52-bfc0-080cae030ba1 req-17ed0073-dbaa-4b66-b581-d2fa3518ce23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864e44a6-db73-473d-967a-bb10611956d8", "tag": "9fe34b5b-8175-4a11-9bbf-412bb3835ae9"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:48.909276 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f0e54244-fb99-4a52-bfc0-080cae030ba1 req-17ed0073-dbaa-4b66-b581-d2fa3518ce23 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:48.910492 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f0e54244-fb99-4a52-bfc0-080cae030ba1 req-17ed0073-dbaa-4b66-b581-d2fa3518ce23 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:48.911611 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-f0e54244-fb99-4a52-bfc0-080cae030ba1 req-17ed0073-dbaa-4b66-b581-d2fa3518ce23 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:48.945884 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-f0e54244-fb99-4a52-bfc0-080cae030ba1 req-17ed0073-dbaa-4b66-b581-d2fa3518ce23 service nova] Creating event network-changed:9fe34b5b-8175-4a11-9bbf-412bb3835ae9 for instance 864e44a6-db73-473d-967a-bb10611956d8 on hv-cinder-84773 Sep 08 14:08:48.968652 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-f0e54244-fb99-4a52-bfc0-080cae030ba1 req-17ed0073-dbaa-4b66-b581-d2fa3518ce23 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087886 Sep 08 14:08:48.974338 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 522/1049] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:49.378069 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-54e38da6-3433-4639-a13f-2c60addcaf44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:49.379053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-54e38da6-3433-4639-a13f-2c60addcaf44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:49.388539 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e38da6-3433-4639-a13f-2c60addcaf44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:49.389034 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e38da6-3433-4639-a13f-2c60addcaf44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:49.389462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e38da6-3433-4639-a13f-2c60addcaf44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:49.390170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e38da6-3433-4639-a13f-2c60addcaf44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:49.390608 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e38da6-3433-4639-a13f-2c60addcaf44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:49.391575 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-54e38da6-3433-4639-a13f-2c60addcaf44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:49.564655 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-54e38da6-3433-4639-a13f-2c60addcaf44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:49.573363 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-54e38da6-3433-4639-a13f-2c60addcaf44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.200804 Sep 08 14:08:49.574701 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 528/1050] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:49 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:49.682765 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f105a3b5-fcbe-4065-9798-2c107acb409c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:49.683560 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f105a3b5-fcbe-4065-9798-2c107acb409c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:49.690508 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f105a3b5-fcbe-4065-9798-2c107acb409c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:49.691034 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f105a3b5-fcbe-4065-9798-2c107acb409c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:49.691479 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f105a3b5-fcbe-4065-9798-2c107acb409c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:49.692175 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f105a3b5-fcbe-4065-9798-2c107acb409c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:49.692637 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f105a3b5-fcbe-4065-9798-2c107acb409c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:49.693064 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f105a3b5-fcbe-4065-9798-2c107acb409c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:49.835167 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f105a3b5-fcbe-4065-9798-2c107acb409c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:49.843260 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f105a3b5-fcbe-4065-9798-2c107acb409c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1319 microversion: 2.1 time: 0.164679 Sep 08 14:08:49.843778 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 523/1051] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:49 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:50.601153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2359f587-44f6-4592-b66c-5d36495591a5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:50.602082 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2359f587-44f6-4592-b66c-5d36495591a5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:50.610775 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2359f587-44f6-4592-b66c-5d36495591a5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:50.610775 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2359f587-44f6-4592-b66c-5d36495591a5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:50.610775 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2359f587-44f6-4592-b66c-5d36495591a5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:50.611602 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2359f587-44f6-4592-b66c-5d36495591a5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:50.611795 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2359f587-44f6-4592-b66c-5d36495591a5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:50.612226 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2359f587-44f6-4592-b66c-5d36495591a5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:50.874776 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6ed3187a-5786-40ec-a3b5-9849ba9aa201 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:50.874776 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6ed3187a-5786-40ec-a3b5-9849ba9aa201 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:50.881927 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ed3187a-5786-40ec-a3b5-9849ba9aa201 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:50.882439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ed3187a-5786-40ec-a3b5-9849ba9aa201 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:50.884045 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ed3187a-5786-40ec-a3b5-9849ba9aa201 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:50.884782 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ed3187a-5786-40ec-a3b5-9849ba9aa201 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:50.888715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ed3187a-5786-40ec-a3b5-9849ba9aa201 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:50.889344 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6ed3187a-5786-40ec-a3b5-9849ba9aa201 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:51.072334 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6ed3187a-5786-40ec-a3b5-9849ba9aa201 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:51.083036 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6ed3187a-5786-40ec-a3b5-9849ba9aa201 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1319 microversion: 2.1 time: 0.216882 Sep 08 14:08:51.084025 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 524/1052] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:50 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:51.133036 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2359f587-44f6-4592-b66c-5d36495591a5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:51.147592 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2359f587-44f6-4592-b66c-5d36495591a5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.553546 Sep 08 14:08:51.151111 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 529/1053] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:50 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:52.107210 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-562462d4-9813-405d-9497-ad1b7f4d313a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:52.107920 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-562462d4-9813-405d-9497-ad1b7f4d313a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:52.114339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-562462d4-9813-405d-9497-ad1b7f4d313a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:52.114832 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-562462d4-9813-405d-9497-ad1b7f4d313a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:52.115301 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-562462d4-9813-405d-9497-ad1b7f4d313a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:52.116019 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-562462d4-9813-405d-9497-ad1b7f4d313a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:52.116470 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-562462d4-9813-405d-9497-ad1b7f4d313a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:52.116892 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-562462d4-9813-405d-9497-ad1b7f4d313a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:52.173800 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e0c66d95-6f51-49c6-9618-30e8c05abd22 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:52.174341 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e0c66d95-6f51-49c6-9618-30e8c05abd22 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:52.181044 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0c66d95-6f51-49c6-9618-30e8c05abd22 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:52.181525 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0c66d95-6f51-49c6-9618-30e8c05abd22 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:52.181966 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0c66d95-6f51-49c6-9618-30e8c05abd22 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:52.182665 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0c66d95-6f51-49c6-9618-30e8c05abd22 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:52.183169 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0c66d95-6f51-49c6-9618-30e8c05abd22 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:52.184097 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e0c66d95-6f51-49c6-9618-30e8c05abd22 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:52.267935 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-562462d4-9813-405d-9497-ad1b7f4d313a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:52.283432 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-562462d4-9813-405d-9497-ad1b7f4d313a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1319 microversion: 2.1 time: 0.179662 Sep 08 14:08:52.284244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 525/1054] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:52 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:52.335777 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e0c66d95-6f51-49c6-9618-30e8c05abd22 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:52.344192 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e0c66d95-6f51-49c6-9618-30e8c05abd22 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.174314 Sep 08 14:08:52.344927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 530/1055] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:52 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:53.309535 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-99c48e5c-7e56-40a7-880f-38e6185fbab4 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:53.310177 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-99c48e5c-7e56-40a7-880f-38e6185fbab4 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:53.316719 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-99c48e5c-7e56-40a7-880f-38e6185fbab4 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:53.317201 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-99c48e5c-7e56-40a7-880f-38e6185fbab4 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:53.317664 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-99c48e5c-7e56-40a7-880f-38e6185fbab4 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:53.318348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-99c48e5c-7e56-40a7-880f-38e6185fbab4 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:53.318800 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-99c48e5c-7e56-40a7-880f-38e6185fbab4 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:53.319257 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-99c48e5c-7e56-40a7-880f-38e6185fbab4 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:53.370195 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-db039b02-4ea8-4672-874d-5a54a1b62465 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:53.370825 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-db039b02-4ea8-4672-874d-5a54a1b62465 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:53.377647 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-db039b02-4ea8-4672-874d-5a54a1b62465 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:53.378323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-db039b02-4ea8-4672-874d-5a54a1b62465 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:53.378843 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-db039b02-4ea8-4672-874d-5a54a1b62465 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:53.379701 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-db039b02-4ea8-4672-874d-5a54a1b62465 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:53.380774 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-db039b02-4ea8-4672-874d-5a54a1b62465 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:53.381215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-db039b02-4ea8-4672-874d-5a54a1b62465 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:53.462390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-99c48e5c-7e56-40a7-880f-38e6185fbab4 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:53.471283 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-99c48e5c-7e56-40a7-880f-38e6185fbab4 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1319 microversion: 2.1 time: 0.165824 Sep 08 14:08:53.475148 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 526/1056] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:53 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:53.598379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-db039b02-4ea8-4672-874d-5a54a1b62465 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:53.606627 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-db039b02-4ea8-4672-874d-5a54a1b62465 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.241456 Sep 08 14:08:53.607256 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 531/1057] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:53 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:54.494008 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ff045d15-613a-4ca3-abbd-bea4ff77869d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:54.494650 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ff045d15-613a-4ca3-abbd-bea4ff77869d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:54.496917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:54.497606 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=6 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:54.503543 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff045d15-613a-4ca3-abbd-bea4ff77869d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:54.511747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff045d15-613a-4ca3-abbd-bea4ff77869d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:54.511747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff045d15-613a-4ca3-abbd-bea4ff77869d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:54.511747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff045d15-613a-4ca3-abbd-bea4ff77869d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:54.511747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff045d15-613a-4ca3-abbd-bea4ff77869d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:54.512158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ff045d15-613a-4ca3-abbd-bea4ff77869d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:54.631854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e5e0c27f-5cc6-4fbd-8e78-d491f0832be5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:54.634044 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e5e0c27f-5cc6-4fbd-8e78-d491f0832be5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:54.642250 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:54.649434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5e0c27f-5cc6-4fbd-8e78-d491f0832be5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:54.649434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5e0c27f-5cc6-4fbd-8e78-d491f0832be5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:54.649434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5e0c27f-5cc6-4fbd-8e78-d491f0832be5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:54.649434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5e0c27f-5cc6-4fbd-8e78-d491f0832be5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:54.649976 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5e0c27f-5cc6-4fbd-8e78-d491f0832be5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:54.649976 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e5e0c27f-5cc6-4fbd-8e78-d491f0832be5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:54.667185 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ff045d15-613a-4ca3-abbd-bea4ff77869d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:54.675813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ff045d15-613a-4ca3-abbd-bea4ff77869d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1319 microversion: 2.1 time: 0.185822 Sep 08 14:08:54.676392 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 527/1058] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:54 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:54.686161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-9f1d78ba-ebd8-4a0b-99e2-f7eadd7f6a3d req-5ca0ec6a-4062-43fc-b4a8-76c04e79f1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864e44a6-db73-473d-967a-bb10611956d8", "name": "network-vif-plugged", "status": "completed", "tag": "9fe34b5b-8175-4a11-9bbf-412bb3835ae9"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:54.690710 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-9f1d78ba-ebd8-4a0b-99e2-f7eadd7f6a3d req-5ca0ec6a-4062-43fc-b4a8-76c04e79f1b0 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:54.691376 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-9f1d78ba-ebd8-4a0b-99e2-f7eadd7f6a3d req-5ca0ec6a-4062-43fc-b4a8-76c04e79f1b0 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:54.692094 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-9f1d78ba-ebd8-4a0b-99e2-f7eadd7f6a3d req-5ca0ec6a-4062-43fc-b4a8-76c04e79f1b0 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:54.705752 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-9f1d78ba-ebd8-4a0b-99e2-f7eadd7f6a3d req-5ca0ec6a-4062-43fc-b4a8-76c04e79f1b0 service nova] Creating event network-vif-plugged:9fe34b5b-8175-4a11-9bbf-412bb3835ae9 for instance 864e44a6-db73-473d-967a-bb10611956d8 on hv-cinder-84773 Sep 08 14:08:54.710786 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-9f1d78ba-ebd8-4a0b-99e2-f7eadd7f6a3d req-5ca0ec6a-4062-43fc-b4a8-76c04e79f1b0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033286 Sep 08 14:08:54.711730 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 528/1059] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:54.809367 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e5e0c27f-5cc6-4fbd-8e78-d491f0832be5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:54.817460 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e5e0c27f-5cc6-4fbd-8e78-d491f0832be5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.191684 Sep 08 14:08:54.818327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 532/1060] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:54 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:55.701614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b883f17f-79f7-445e-94a5-3053ef3284f2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:55.702599 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b883f17f-79f7-445e-94a5-3053ef3284f2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:55.709824 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b883f17f-79f7-445e-94a5-3053ef3284f2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:55.710590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b883f17f-79f7-445e-94a5-3053ef3284f2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:55.711280 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b883f17f-79f7-445e-94a5-3053ef3284f2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:55.712717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b883f17f-79f7-445e-94a5-3053ef3284f2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:55.713308 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b883f17f-79f7-445e-94a5-3053ef3284f2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:55.714960 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b883f17f-79f7-445e-94a5-3053ef3284f2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:55.841818 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-57eb224e-4c0e-409d-ae0a-ec1a513b7f7d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:55.843342 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-57eb224e-4c0e-409d-ae0a-ec1a513b7f7d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:55.858254 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57eb224e-4c0e-409d-ae0a-ec1a513b7f7d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:55.859388 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57eb224e-4c0e-409d-ae0a-ec1a513b7f7d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:55.860012 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57eb224e-4c0e-409d-ae0a-ec1a513b7f7d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:55.860723 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57eb224e-4c0e-409d-ae0a-ec1a513b7f7d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:55.861343 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57eb224e-4c0e-409d-ae0a-ec1a513b7f7d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:55.861928 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-57eb224e-4c0e-409d-ae0a-ec1a513b7f7d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:55.883191 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b883f17f-79f7-445e-94a5-3053ef3284f2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:55.894043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b883f17f-79f7-445e-94a5-3053ef3284f2 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1319 microversion: 2.1 time: 0.198102 Sep 08 14:08:55.895022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 529/1061] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:55 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:56.044742 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-57eb224e-4c0e-409d-ae0a-ec1a513b7f7d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:56.053296 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-57eb224e-4c0e-409d-ae0a-ec1a513b7f7d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.215470 Sep 08 14:08:56.053867 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 533/1062] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:55 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:56.920936 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5fad413f-152e-4980-8e8f-f4363ae2b626 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:56.921679 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5fad413f-152e-4980-8e8f-f4363ae2b626 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:56.931387 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5fad413f-152e-4980-8e8f-f4363ae2b626 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:56.932142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5fad413f-152e-4980-8e8f-f4363ae2b626 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:56.932887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5fad413f-152e-4980-8e8f-f4363ae2b626 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:56.934046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5fad413f-152e-4980-8e8f-f4363ae2b626 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:56.934709 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5fad413f-152e-4980-8e8f-f4363ae2b626 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:56.935936 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5fad413f-152e-4980-8e8f-f4363ae2b626 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:57.076828 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ca1a81e2-5d48-436e-8810-dccd465e3d02 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:57.077433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ca1a81e2-5d48-436e-8810-dccd465e3d02 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:57.084856 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca1a81e2-5d48-436e-8810-dccd465e3d02 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:57.096332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca1a81e2-5d48-436e-8810-dccd465e3d02 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:57.096332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca1a81e2-5d48-436e-8810-dccd465e3d02 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:57.096332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca1a81e2-5d48-436e-8810-dccd465e3d02 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:57.096332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca1a81e2-5d48-436e-8810-dccd465e3d02 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:57.096875 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ca1a81e2-5d48-436e-8810-dccd465e3d02 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:57.106558 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5fad413f-152e-4980-8e8f-f4363ae2b626 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:57.116181 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5fad413f-152e-4980-8e8f-f4363ae2b626 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1319 microversion: 2.1 time: 0.199880 Sep 08 14:08:57.128572 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 530/1063] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:56 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:57.250172 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-ca1a81e2-5d48-436e-8810-dccd465e3d02 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:57.258868 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ca1a81e2-5d48-436e-8810-dccd465e3d02 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.186221 Sep 08 14:08:57.259698 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 534/1064] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:57 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:58.142708 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-7a2fb827-e04c-4c70-a725-dbe081e74572 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:58.143464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-7a2fb827-e04c-4c70-a725-dbe081e74572 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:58.149966 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a2fb827-e04c-4c70-a725-dbe081e74572 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:58.150766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a2fb827-e04c-4c70-a725-dbe081e74572 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:58.151290 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a2fb827-e04c-4c70-a725-dbe081e74572 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:58.152057 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a2fb827-e04c-4c70-a725-dbe081e74572 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:58.152848 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a2fb827-e04c-4c70-a725-dbe081e74572 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:58.153907 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-7a2fb827-e04c-4c70-a725-dbe081e74572 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:58.298601 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7bf65d3f-e5aa-4a98-94a2-4774b7b2bd74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:58.302788 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7bf65d3f-e5aa-4a98-94a2-4774b7b2bd74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:58.318268 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-7a2fb827-e04c-4c70-a725-dbe081e74572 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:58.319238 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7bf65d3f-e5aa-4a98-94a2-4774b7b2bd74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:58.320140 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7bf65d3f-e5aa-4a98-94a2-4774b7b2bd74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:58.320846 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7bf65d3f-e5aa-4a98-94a2-4774b7b2bd74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:58.322149 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7bf65d3f-e5aa-4a98-94a2-4774b7b2bd74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:58.323376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7bf65d3f-e5aa-4a98-94a2-4774b7b2bd74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:58.324419 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7bf65d3f-e5aa-4a98-94a2-4774b7b2bd74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:58.328142 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-7a2fb827-e04c-4c70-a725-dbe081e74572 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1507 microversion: 2.1 time: 0.190925 Sep 08 14:08:58.329310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 531/1065] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:58 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:58.499712 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7bf65d3f-e5aa-4a98-94a2-4774b7b2bd74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:58.511323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7bf65d3f-e5aa-4a98-94a2-4774b7b2bd74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.230557 Sep 08 14:08:58.512325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 535/1066] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:58 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:59.539571 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b2decb84-82b1-4abf-8154-c8febe8a0d6c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:59.540182 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b2decb84-82b1-4abf-8154-c8febe8a0d6c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:59.547517 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b2decb84-82b1-4abf-8154-c8febe8a0d6c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:59.548005 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b2decb84-82b1-4abf-8154-c8febe8a0d6c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:59.548443 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b2decb84-82b1-4abf-8154-c8febe8a0d6c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:59.549165 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b2decb84-82b1-4abf-8154-c8febe8a0d6c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:59.549648 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b2decb84-82b1-4abf-8154-c8febe8a0d6c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:59.550072 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b2decb84-82b1-4abf-8154-c8febe8a0d6c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:59.703268 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b2decb84-82b1-4abf-8154-c8febe8a0d6c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:59.711736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b2decb84-82b1-4abf-8154-c8febe8a0d6c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.176180 Sep 08 14:08:59.712308 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 532/1067] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:59 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:00.736843 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7e2308f2-e594-4547-96bf-ffa5f0de4ef3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:00.737487 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7e2308f2-e594-4547-96bf-ffa5f0de4ef3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:00.744170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e2308f2-e594-4547-96bf-ffa5f0de4ef3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:00.744886 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e2308f2-e594-4547-96bf-ffa5f0de4ef3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:00.745326 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e2308f2-e594-4547-96bf-ffa5f0de4ef3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:00.746038 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e2308f2-e594-4547-96bf-ffa5f0de4ef3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:00.746494 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e2308f2-e594-4547-96bf-ffa5f0de4ef3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:00.746942 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7e2308f2-e594-4547-96bf-ffa5f0de4ef3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:00.897830 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7e2308f2-e594-4547-96bf-ffa5f0de4ef3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:00.907389 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7e2308f2-e594-4547-96bf-ffa5f0de4ef3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.174983 Sep 08 14:09:00.915994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 536/1068] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:00 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:01.932032 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4712e26c-cdba-4356-92b8-7964626e33dc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:01.932783 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4712e26c-cdba-4356-92b8-7964626e33dc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:01.941307 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4712e26c-cdba-4356-92b8-7964626e33dc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:01.941969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4712e26c-cdba-4356-92b8-7964626e33dc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:01.946015 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4712e26c-cdba-4356-92b8-7964626e33dc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:01.948339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4712e26c-cdba-4356-92b8-7964626e33dc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:01.949874 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4712e26c-cdba-4356-92b8-7964626e33dc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:01.951054 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4712e26c-cdba-4356-92b8-7964626e33dc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:02.097265 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4712e26c-cdba-4356-92b8-7964626e33dc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:02.105298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4712e26c-cdba-4356-92b8-7964626e33dc tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1509 microversion: 2.1 time: 0.177255 Sep 08 14:09:02.105882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 533/1069] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:01 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:02.136090 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8bc50dc1-574a-45f8-aa3d-1d9c8a771b5d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:02.136455 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8bc50dc1-574a-45f8-aa3d-1d9c8a771b5d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:02.143814 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8bc50dc1-574a-45f8-aa3d-1d9c8a771b5d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:02.144298 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8bc50dc1-574a-45f8-aa3d-1d9c8a771b5d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:02.144789 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8bc50dc1-574a-45f8-aa3d-1d9c8a771b5d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:02.145558 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8bc50dc1-574a-45f8-aa3d-1d9c8a771b5d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:02.146263 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8bc50dc1-574a-45f8-aa3d-1d9c8a771b5d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:02.146723 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8bc50dc1-574a-45f8-aa3d-1d9c8a771b5d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:02.183444 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8bc50dc1-574a-45f8-aa3d-1d9c8a771b5d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133059) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 14:09:02.337443 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:02.521742 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8bc50dc1-574a-45f8-aa3d-1d9c8a771b5d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "POST /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b/action" status: 202 len: 0 microversion: 2.1 time: 0.395536 Sep 08 14:09:02.522402 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 537/1070] 10.222.0.91 () {60 vars in 1278 bytes} [Thu Sep 8 14:09:02 2022] POST /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:09:02.531158 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6fd631ae-a2f1-4ead-a55f-3b86d181e58d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:02.531976 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6fd631ae-a2f1-4ead-a55f-3b86d181e58d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:02.539718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fd631ae-a2f1-4ead-a55f-3b86d181e58d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:02.540898 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fd631ae-a2f1-4ead-a55f-3b86d181e58d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:02.544962 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fd631ae-a2f1-4ead-a55f-3b86d181e58d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:02.545631 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fd631ae-a2f1-4ead-a55f-3b86d181e58d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:02.546130 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fd631ae-a2f1-4ead-a55f-3b86d181e58d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:02.546652 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6fd631ae-a2f1-4ead-a55f-3b86d181e58d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:02.725529 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6fd631ae-a2f1-4ead-a55f-3b86d181e58d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:02.734057 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6fd631ae-a2f1-4ead-a55f-3b86d181e58d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1517 microversion: 2.1 time: 0.207304 Sep 08 14:09:02.735122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 534/1071] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:02 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:03.762530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-10e859f4-b693-493e-94c7-4c04b622b70b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:03.763214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-10e859f4-b693-493e-94c7-4c04b622b70b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:03.770252 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10e859f4-b693-493e-94c7-4c04b622b70b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:03.770739 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10e859f4-b693-493e-94c7-4c04b622b70b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:03.771517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10e859f4-b693-493e-94c7-4c04b622b70b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:03.772219 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10e859f4-b693-493e-94c7-4c04b622b70b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:03.772669 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10e859f4-b693-493e-94c7-4c04b622b70b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:03.773089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10e859f4-b693-493e-94c7-4c04b622b70b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:03.937975 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-10e859f4-b693-493e-94c7-4c04b622b70b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:03.946767 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-10e859f4-b693-493e-94c7-4c04b622b70b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1517 microversion: 2.1 time: 0.192754 Sep 08 14:09:03.947456 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 538/1072] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:03 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:04.521348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-142a11c8-71f6-4024-8924-00973fdc5bca req-92747049-867a-42dd-bbaa-7a755318fa7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e11d590-d8c5-4b4a-ba5d-0a0ae203954b", "name": "network-vif-unplugged", "status": "completed", "tag": "2bb33aac-6854-44c1-9bf8-4f4c73e872c4"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:04.532990 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-142a11c8-71f6-4024-8924-00973fdc5bca req-92747049-867a-42dd-bbaa-7a755318fa7f service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:04.533588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-142a11c8-71f6-4024-8924-00973fdc5bca req-92747049-867a-42dd-bbaa-7a755318fa7f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:04.534080 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-142a11c8-71f6-4024-8924-00973fdc5bca req-92747049-867a-42dd-bbaa-7a755318fa7f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:04.545538 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.compute.server_external_events [req-142a11c8-71f6-4024-8924-00973fdc5bca req-92747049-867a-42dd-bbaa-7a755318fa7f service nova] Unable to find a host for instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b. Dropping event network-vif-unplugged {{(pid=133058) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 14:09:04.546413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-142a11c8-71f6-4024-8924-00973fdc5bca req-92747049-867a-42dd-bbaa-7a755318fa7f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029294 Sep 08 14:09:04.549176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 535/1073] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 14:09:04.971116 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-597e0278-0893-4fd5-a13b-fe7ff1708599 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:04.971734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-597e0278-0893-4fd5-a13b-fe7ff1708599 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:04.978787 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-597e0278-0893-4fd5-a13b-fe7ff1708599 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:04.979328 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-597e0278-0893-4fd5-a13b-fe7ff1708599 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:04.979765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-597e0278-0893-4fd5-a13b-fe7ff1708599 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:04.980472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-597e0278-0893-4fd5-a13b-fe7ff1708599 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:04.980928 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-597e0278-0893-4fd5-a13b-fe7ff1708599 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:04.981354 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-597e0278-0893-4fd5-a13b-fe7ff1708599 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:05.118096 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-597e0278-0893-4fd5-a13b-fe7ff1708599 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:05.127053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-597e0278-0893-4fd5-a13b-fe7ff1708599 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1519 microversion: 2.1 time: 0.160069 Sep 08 14:09:05.127749 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 539/1074] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:04 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:06.154471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6067efd5-cf13-4a6e-85dd-7f6849267ab5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:06.157771 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6067efd5-cf13-4a6e-85dd-7f6849267ab5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:06.164459 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6067efd5-cf13-4a6e-85dd-7f6849267ab5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:06.164956 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6067efd5-cf13-4a6e-85dd-7f6849267ab5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:06.165448 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6067efd5-cf13-4a6e-85dd-7f6849267ab5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:06.166147 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6067efd5-cf13-4a6e-85dd-7f6849267ab5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:06.166771 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6067efd5-cf13-4a6e-85dd-7f6849267ab5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:06.167308 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6067efd5-cf13-4a6e-85dd-7f6849267ab5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:06.305794 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6067efd5-cf13-4a6e-85dd-7f6849267ab5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:06.314610 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6067efd5-cf13-4a6e-85dd-7f6849267ab5 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.164020 Sep 08 14:09:06.315766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 536/1075] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:06 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:07.339048 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-c50ef4ce-f575-4c1d-8d89-09b9513e8422 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:07.339680 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-c50ef4ce-f575-4c1d-8d89-09b9513e8422 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:07.346146 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c50ef4ce-f575-4c1d-8d89-09b9513e8422 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:07.346617 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c50ef4ce-f575-4c1d-8d89-09b9513e8422 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:07.347086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c50ef4ce-f575-4c1d-8d89-09b9513e8422 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:07.347768 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c50ef4ce-f575-4c1d-8d89-09b9513e8422 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:07.348218 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c50ef4ce-f575-4c1d-8d89-09b9513e8422 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:07.348631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-c50ef4ce-f575-4c1d-8d89-09b9513e8422 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:07.493352 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-c50ef4ce-f575-4c1d-8d89-09b9513e8422 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:07.502575 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-c50ef4ce-f575-4c1d-8d89-09b9513e8422 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.167401 Sep 08 14:09:07.503198 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 540/1076] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:07 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:08.525809 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9e13ddbd-08f0-42ba-9216-4f20cb87a9f9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:08.526588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9e13ddbd-08f0-42ba-9216-4f20cb87a9f9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:08.529186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:08.535526 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9e13ddbd-08f0-42ba-9216-4f20cb87a9f9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:08.536223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9e13ddbd-08f0-42ba-9216-4f20cb87a9f9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:08.536661 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9e13ddbd-08f0-42ba-9216-4f20cb87a9f9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:08.537370 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9e13ddbd-08f0-42ba-9216-4f20cb87a9f9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:08.537848 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9e13ddbd-08f0-42ba-9216-4f20cb87a9f9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:08.538272 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9e13ddbd-08f0-42ba-9216-4f20cb87a9f9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:08.542776 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=99 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:08.692409 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9e13ddbd-08f0-42ba-9216-4f20cb87a9f9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:08.700656 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9e13ddbd-08f0-42ba-9216-4f20cb87a9f9 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.178677 Sep 08 14:09:08.701241 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 537/1077] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:08 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:09.725210 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-87e2db78-d5f6-49ed-977e-f40c6826fe15 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:09.725821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-87e2db78-d5f6-49ed-977e-f40c6826fe15 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:09.728170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:09.733057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-87e2db78-d5f6-49ed-977e-f40c6826fe15 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:09.733472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-87e2db78-d5f6-49ed-977e-f40c6826fe15 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:09.733909 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-87e2db78-d5f6-49ed-977e-f40c6826fe15 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:09.734599 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-87e2db78-d5f6-49ed-977e-f40c6826fe15 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:09.735089 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-87e2db78-d5f6-49ed-977e-f40c6826fe15 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:09.735513 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-87e2db78-d5f6-49ed-977e-f40c6826fe15 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:09.874452 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-87e2db78-d5f6-49ed-977e-f40c6826fe15 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:09.883009 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-87e2db78-d5f6-49ed-977e-f40c6826fe15 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.161681 Sep 08 14:09:09.883769 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 541/1078] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:09 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:10.906307 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3b7d53cd-1e04-4318-94e8-c960a11f3470 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:10.906840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3b7d53cd-1e04-4318-94e8-c960a11f3470 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:10.913333 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b7d53cd-1e04-4318-94e8-c960a11f3470 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:10.913829 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b7d53cd-1e04-4318-94e8-c960a11f3470 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:10.914252 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b7d53cd-1e04-4318-94e8-c960a11f3470 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:10.914965 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b7d53cd-1e04-4318-94e8-c960a11f3470 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:10.915421 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b7d53cd-1e04-4318-94e8-c960a11f3470 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:10.915846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3b7d53cd-1e04-4318-94e8-c960a11f3470 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:11.067686 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3b7d53cd-1e04-4318-94e8-c960a11f3470 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:11.075819 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3b7d53cd-1e04-4318-94e8-c960a11f3470 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.173509 Sep 08 14:09:11.076388 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 538/1079] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:10 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:12.100939 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f9f1ca10-5ef3-46b1-91a1-12f939d66025 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:12.101550 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f9f1ca10-5ef3-46b1-91a1-12f939d66025 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:12.108451 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9f1ca10-5ef3-46b1-91a1-12f939d66025 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:12.108933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9f1ca10-5ef3-46b1-91a1-12f939d66025 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:12.109545 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9f1ca10-5ef3-46b1-91a1-12f939d66025 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:12.110272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9f1ca10-5ef3-46b1-91a1-12f939d66025 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:12.110723 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9f1ca10-5ef3-46b1-91a1-12f939d66025 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:12.111164 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f9f1ca10-5ef3-46b1-91a1-12f939d66025 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:12.272633 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f9f1ca10-5ef3-46b1-91a1-12f939d66025 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:12.281057 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f9f1ca10-5ef3-46b1-91a1-12f939d66025 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.184747 Sep 08 14:09:12.287910 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 542/1080] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:12 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:13.304428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-24798d60-4fb5-4512-a191-e7ffed1e2439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:13.305118 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-24798d60-4fb5-4512-a191-e7ffed1e2439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:13.312187 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24798d60-4fb5-4512-a191-e7ffed1e2439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:13.312739 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24798d60-4fb5-4512-a191-e7ffed1e2439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:13.313248 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24798d60-4fb5-4512-a191-e7ffed1e2439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:13.313953 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24798d60-4fb5-4512-a191-e7ffed1e2439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:13.314382 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24798d60-4fb5-4512-a191-e7ffed1e2439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:13.314792 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-24798d60-4fb5-4512-a191-e7ffed1e2439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:13.447472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-24798d60-4fb5-4512-a191-e7ffed1e2439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:13.456114 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-24798d60-4fb5-4512-a191-e7ffed1e2439 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.155603 Sep 08 14:09:13.456677 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 539/1081] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:13 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:14.484462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9aecdd8b-d926-403f-8225-aa2f716c5a74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:14.484462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9aecdd8b-d926-403f-8225-aa2f716c5a74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:14.487402 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aecdd8b-d926-403f-8225-aa2f716c5a74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:14.487888 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aecdd8b-d926-403f-8225-aa2f716c5a74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:14.488319 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aecdd8b-d926-403f-8225-aa2f716c5a74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:14.489014 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aecdd8b-d926-403f-8225-aa2f716c5a74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:14.489461 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aecdd8b-d926-403f-8225-aa2f716c5a74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:14.489880 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9aecdd8b-d926-403f-8225-aa2f716c5a74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:14.626223 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9aecdd8b-d926-403f-8225-aa2f716c5a74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:14.633972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9aecdd8b-d926-403f-8225-aa2f716c5a74 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.158537 Sep 08 14:09:14.634532 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 543/1082] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:14 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:15.657912 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1e6ba7fb-1a64-4dad-a7b8-d965aceafb6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:15.659847 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1e6ba7fb-1a64-4dad-a7b8-d965aceafb6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:15.666575 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e6ba7fb-1a64-4dad-a7b8-d965aceafb6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:15.667087 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e6ba7fb-1a64-4dad-a7b8-d965aceafb6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:15.667526 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e6ba7fb-1a64-4dad-a7b8-d965aceafb6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:15.668225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e6ba7fb-1a64-4dad-a7b8-d965aceafb6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:15.668681 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e6ba7fb-1a64-4dad-a7b8-d965aceafb6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:15.669108 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e6ba7fb-1a64-4dad-a7b8-d965aceafb6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:15.813804 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1e6ba7fb-1a64-4dad-a7b8-d965aceafb6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:15.822015 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1e6ba7fb-1a64-4dad-a7b8-d965aceafb6a tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.168238 Sep 08 14:09:15.822866 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 540/1083] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:15 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:16.846240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-10eabc70-bb5d-4410-82a2-9810fa89b54b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:16.847039 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-10eabc70-bb5d-4410-82a2-9810fa89b54b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:16.853895 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10eabc70-bb5d-4410-82a2-9810fa89b54b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:16.854424 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10eabc70-bb5d-4410-82a2-9810fa89b54b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:16.854946 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10eabc70-bb5d-4410-82a2-9810fa89b54b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:16.855587 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10eabc70-bb5d-4410-82a2-9810fa89b54b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:16.856035 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10eabc70-bb5d-4410-82a2-9810fa89b54b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:16.856452 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-10eabc70-bb5d-4410-82a2-9810fa89b54b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:17.005446 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-10eabc70-bb5d-4410-82a2-9810fa89b54b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:17.013930 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-10eabc70-bb5d-4410-82a2-9810fa89b54b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.171947 Sep 08 14:09:17.014579 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 544/1084] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:16 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:18.037936 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e20c1569-dd41-4a2b-ac53-2f92294c2111 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:18.038588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e20c1569-dd41-4a2b-ac53-2f92294c2111 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:18.045528 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e20c1569-dd41-4a2b-ac53-2f92294c2111 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:18.046019 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e20c1569-dd41-4a2b-ac53-2f92294c2111 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:18.046550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e20c1569-dd41-4a2b-ac53-2f92294c2111 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:18.047248 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e20c1569-dd41-4a2b-ac53-2f92294c2111 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:18.047708 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e20c1569-dd41-4a2b-ac53-2f92294c2111 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:18.048137 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e20c1569-dd41-4a2b-ac53-2f92294c2111 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:18.192111 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e20c1569-dd41-4a2b-ac53-2f92294c2111 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:18.202426 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e20c1569-dd41-4a2b-ac53-2f92294c2111 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.168022 Sep 08 14:09:18.203343 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 541/1085] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:18 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:18.656840 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-ccbe5a25-09fc-4236-b7bf-d29edee03f69 req-4abceaa8-fc09-43b6-b4f4-7c6da620be04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e11d590-d8c5-4b4a-ba5d-0a0ae203954b", "name": "network-vif-plugged", "status": "completed", "tag": "2bb33aac-6854-44c1-9bf8-4f4c73e872c4"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:18.667313 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-ccbe5a25-09fc-4236-b7bf-d29edee03f69 req-4abceaa8-fc09-43b6-b4f4-7c6da620be04 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:18.667790 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-ccbe5a25-09fc-4236-b7bf-d29edee03f69 req-4abceaa8-fc09-43b6-b4f4-7c6da620be04 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:18.668215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-ccbe5a25-09fc-4236-b7bf-d29edee03f69 req-4abceaa8-fc09-43b6-b4f4-7c6da620be04 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:18.680207 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-ccbe5a25-09fc-4236-b7bf-d29edee03f69 req-4abceaa8-fc09-43b6-b4f4-7c6da620be04 service nova] Creating event network-vif-plugged:2bb33aac-6854-44c1-9bf8-4f4c73e872c4 for instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b on hv-cinder-84773 Sep 08 14:09:18.685613 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-ccbe5a25-09fc-4236-b7bf-d29edee03f69 req-4abceaa8-fc09-43b6-b4f4-7c6da620be04 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032598 Sep 08 14:09:18.686961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 545/1086] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:19.231561 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e8ee932b-f2b9-49d9-abb0-a7fe7b39439d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:19.232203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e8ee932b-f2b9-49d9-abb0-a7fe7b39439d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:19.239488 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8ee932b-f2b9-49d9-abb0-a7fe7b39439d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:19.239985 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8ee932b-f2b9-49d9-abb0-a7fe7b39439d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:19.240419 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8ee932b-f2b9-49d9-abb0-a7fe7b39439d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:19.241110 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8ee932b-f2b9-49d9-abb0-a7fe7b39439d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:19.241564 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8ee932b-f2b9-49d9-abb0-a7fe7b39439d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:19.241985 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e8ee932b-f2b9-49d9-abb0-a7fe7b39439d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:19.373686 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e8ee932b-f2b9-49d9-abb0-a7fe7b39439d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:19.381557 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e8ee932b-f2b9-49d9-abb0-a7fe7b39439d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.154026 Sep 08 14:09:19.382122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 542/1087] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:19 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:20.406229 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-550a0393-ae71-4ada-9dbb-d646c96b957b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:20.406970 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-550a0393-ae71-4ada-9dbb-d646c96b957b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:20.413182 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-550a0393-ae71-4ada-9dbb-d646c96b957b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:20.413668 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-550a0393-ae71-4ada-9dbb-d646c96b957b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:20.414103 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-550a0393-ae71-4ada-9dbb-d646c96b957b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:20.414797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-550a0393-ae71-4ada-9dbb-d646c96b957b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:20.415276 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-550a0393-ae71-4ada-9dbb-d646c96b957b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:20.415804 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-550a0393-ae71-4ada-9dbb-d646c96b957b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:20.551345 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-550a0393-ae71-4ada-9dbb-d646c96b957b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:20.558923 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-550a0393-ae71-4ada-9dbb-d646c96b957b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.158154 Sep 08 14:09:20.559547 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 546/1088] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:20 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:21.583438 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1e96405d-e637-4e0e-a712-29a19c594264 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:21.584049 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1e96405d-e637-4e0e-a712-29a19c594264 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:21.590690 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e96405d-e637-4e0e-a712-29a19c594264 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:21.591211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e96405d-e637-4e0e-a712-29a19c594264 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:21.591653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e96405d-e637-4e0e-a712-29a19c594264 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:21.592333 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e96405d-e637-4e0e-a712-29a19c594264 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:21.592785 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e96405d-e637-4e0e-a712-29a19c594264 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:21.593206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e96405d-e637-4e0e-a712-29a19c594264 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:21.724746 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1e96405d-e637-4e0e-a712-29a19c594264 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:21.733627 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1e96405d-e637-4e0e-a712-29a19c594264 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.153723 Sep 08 14:09:21.734123 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 543/1089] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:21 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:22.758053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8f1950a0-2e80-4ff3-a3c6-f22c91355f0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:22.758919 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8f1950a0-2e80-4ff3-a3c6-f22c91355f0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:22.765815 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f1950a0-2e80-4ff3-a3c6-f22c91355f0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:22.766297 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f1950a0-2e80-4ff3-a3c6-f22c91355f0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:22.766730 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f1950a0-2e80-4ff3-a3c6-f22c91355f0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:22.767452 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f1950a0-2e80-4ff3-a3c6-f22c91355f0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:22.767906 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f1950a0-2e80-4ff3-a3c6-f22c91355f0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:22.768325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8f1950a0-2e80-4ff3-a3c6-f22c91355f0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:22.901062 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8f1950a0-2e80-4ff3-a3c6-f22c91355f0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:22.909146 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8f1950a0-2e80-4ff3-a3c6-f22c91355f0c tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1575 microversion: 2.1 time: 0.155442 Sep 08 14:09:22.909794 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 547/1090] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:22 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:23.932026 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2da427d8-000a-46c2-a130-74ef4633200d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:23.932733 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2da427d8-000a-46c2-a130-74ef4633200d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:23.945492 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2da427d8-000a-46c2-a130-74ef4633200d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:23.945492 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2da427d8-000a-46c2-a130-74ef4633200d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:23.945492 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2da427d8-000a-46c2-a130-74ef4633200d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:23.945492 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2da427d8-000a-46c2-a130-74ef4633200d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:23.945988 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2da427d8-000a-46c2-a130-74ef4633200d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:23.945988 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2da427d8-000a-46c2-a130-74ef4633200d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.082879 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2da427d8-000a-46c2-a130-74ef4633200d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:24.093987 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2da427d8-000a-46c2-a130-74ef4633200d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1562 microversion: 2.1 time: 0.165701 Sep 08 14:09:24.100530 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 544/1091] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:23 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:28.337772 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2e928fd9-e751-4fbd-8b60-c74a315a8e3b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f59f4c5-317c-46d7-a9a7-c93dfe341656", "device": "/dev/sdb"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:28.342626 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2e928fd9-e751-4fbd-8b60-c74a315a8e3b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:28.352419 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e928fd9-e751-4fbd-8b60-c74a315a8e3b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:28.353269 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e928fd9-e751-4fbd-8b60-c74a315a8e3b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:28.353939 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e928fd9-e751-4fbd-8b60-c74a315a8e3b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:28.355053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e928fd9-e751-4fbd-8b60-c74a315a8e3b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:28.355848 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e928fd9-e751-4fbd-8b60-c74a315a8e3b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:28.356585 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2e928fd9-e751-4fbd-8b60-c74a315a8e3b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:30.871053 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2e928fd9-e751-4fbd-8b60-c74a315a8e3b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "POST /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.539824 Sep 08 14:09:30.872110 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 548/1092] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:09:28 2022] POST /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8/os-volume_attachments => generated 194 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:54.598521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=15 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:54.599332 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=47 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:54.600122 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:09:54.600262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Thu Sep 8 14:09:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.91) !!! Sep 08 14:09:54.774585 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-111fcd55-78c3-4c75-af8a-0de75dc5a2a2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Action: 'create', calling method: .version_select at 0x7f5200d48430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-753369397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYdxZuZdNcDAnx0c1JZOGAzc6OtY9aar2usksa2dFXrZpNd0gVXLaRfuDKLH/obPyI/Blbt86uxuJWjG2DanHLP8FIvGtKYWmwShjKlYO2eoc1N6zXziEMTzGsQ6c/AXw=="}} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:54.790570 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-111fcd55-78c3-4c75-af8a-0de75dc5a2a2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Getting quotas for project f7224a31a8aa4e7ca9514d77b5f00526. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:09:54.796018 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.quota [None req-111fcd55-78c3-4c75-af8a-0de75dc5a2a2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Getting quotas for user 4b8776b82114444cbe35aa534fe14fa2 and project f7224a31a8aa4e7ca9514d77b5f00526. Resources: {'key_pairs'} {{(pid=133058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:09:54.928731 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-111fcd55-78c3-4c75-af8a-0de75dc5a2a2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.334887 Sep 08 14:09:54.929240 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 545/1093] 10.222.0.91 () {60 vars in 1159 bytes} [Thu Sep 8 14:09:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:59.185513 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9ae639ec-1d04-4b31-87cf-967ed2a6242b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:59.189080 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9ae639ec-1d04-4b31-87cf-967ed2a6242b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:59.194322 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=15 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:59.195488 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:59.197327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ae639ec-1d04-4b31-87cf-967ed2a6242b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:59.197823 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ae639ec-1d04-4b31-87cf-967ed2a6242b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:59.198262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ae639ec-1d04-4b31-87cf-967ed2a6242b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:59.199006 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ae639ec-1d04-4b31-87cf-967ed2a6242b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:59.199641 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ae639ec-1d04-4b31-87cf-967ed2a6242b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:59.200068 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9ae639ec-1d04-4b31-87cf-967ed2a6242b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:59.395613 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-9ae639ec-1d04-4b31-87cf-967ed2a6242b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lazy-loading 'services' on Instance uuid 864e44a6-db73-473d-967a-bb10611956d8 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:09:59.596043 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9ae639ec-1d04-4b31-87cf-967ed2a6242b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "DELETE /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8/os-volume_attachments/5f59f4c5-317c-46d7-a9a7-c93dfe341656" status: 202 len: 0 microversion: 2.1 time: 0.416315 Sep 08 14:09:59.596809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 549/1094] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:09:59 2022] DELETE /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8/os-volume_attachments/5f59f4c5-317c-46d7-a9a7-c93dfe341656 => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:10:01.821966 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4495aa0c-ded5-45b7-9c54-49e4674e173c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:01.822631 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4495aa0c-ded5-45b7-9c54-49e4674e173c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:01.829732 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4495aa0c-ded5-45b7-9c54-49e4674e173c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:01.830221 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4495aa0c-ded5-45b7-9c54-49e4674e173c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:01.830658 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4495aa0c-ded5-45b7-9c54-49e4674e173c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:01.831608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4495aa0c-ded5-45b7-9c54-49e4674e173c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:01.831842 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4495aa0c-ded5-45b7-9c54-49e4674e173c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:01.832273 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4495aa0c-ded5-45b7-9c54-49e4674e173c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:01.859332 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4495aa0c-ded5-45b7-9c54-49e4674e173c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:10:02.185943 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4495aa0c-ded5-45b7-9c54-49e4674e173c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "DELETE /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 204 len: 0 microversion: 2.1 time: 0.368080 Sep 08 14:10:02.186538 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 546/1095] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:10:01 2022] DELETE /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:10:02.196191 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-83c87d58-398e-42d6-bfa9-f31a3b853758 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:02.196883 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-83c87d58-398e-42d6-bfa9-f31a3b853758 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:02.203652 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83c87d58-398e-42d6-bfa9-f31a3b853758 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:02.204125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83c87d58-398e-42d6-bfa9-f31a3b853758 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:02.204585 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83c87d58-398e-42d6-bfa9-f31a3b853758 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:02.205293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83c87d58-398e-42d6-bfa9-f31a3b853758 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:02.205768 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83c87d58-398e-42d6-bfa9-f31a3b853758 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:02.206186 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-83c87d58-398e-42d6-bfa9-f31a3b853758 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:02.344479 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-83c87d58-398e-42d6-bfa9-f31a3b853758 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:02.352441 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-83c87d58-398e-42d6-bfa9-f31a3b853758 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1513 microversion: 2.1 time: 0.161165 Sep 08 14:10:02.353007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 550/1096] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:02 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:03.377206 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-de348fc0-4f9e-45c9-b1ee-7fe9b582f397 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:03.378025 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-de348fc0-4f9e-45c9-b1ee-7fe9b582f397 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:03.384984 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-de348fc0-4f9e-45c9-b1ee-7fe9b582f397 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:03.385517 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-de348fc0-4f9e-45c9-b1ee-7fe9b582f397 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:03.385951 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-de348fc0-4f9e-45c9-b1ee-7fe9b582f397 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:03.386666 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-de348fc0-4f9e-45c9-b1ee-7fe9b582f397 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:03.387146 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-de348fc0-4f9e-45c9-b1ee-7fe9b582f397 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:03.387560 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-de348fc0-4f9e-45c9-b1ee-7fe9b582f397 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:03.625639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-de348fc0-4f9e-45c9-b1ee-7fe9b582f397 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:03.634551 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-de348fc0-4f9e-45c9-b1ee-7fe9b582f397 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1513 microversion: 2.1 time: 0.261434 Sep 08 14:10:03.635265 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 547/1097] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:03 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1513 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:04.657538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b22e6508-e9a3-4f49-8d40-ca6b43642903 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:04.658143 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b22e6508-e9a3-4f49-8d40-ca6b43642903 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:04.664702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b22e6508-e9a3-4f49-8d40-ca6b43642903 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:04.665187 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b22e6508-e9a3-4f49-8d40-ca6b43642903 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:04.665627 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b22e6508-e9a3-4f49-8d40-ca6b43642903 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:04.666328 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b22e6508-e9a3-4f49-8d40-ca6b43642903 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:04.666785 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b22e6508-e9a3-4f49-8d40-ca6b43642903 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:04.667247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b22e6508-e9a3-4f49-8d40-ca6b43642903 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:04.763521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b22e6508-e9a3-4f49-8d40-ca6b43642903 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:04.771589 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b22e6508-e9a3-4f49-8d40-ca6b43642903 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1471 microversion: 2.1 time: 0.118063 Sep 08 14:10:04.772167 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 551/1098] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:04 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1471 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:04.795695 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-46af2ace-4157-460c-a231-f79b41abf3c3 req-d963a8c6-d286-41d4-be8c-8647521f01ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864e44a6-db73-473d-967a-bb10611956d8", "name": "network-vif-deleted", "tag": "9fe34b5b-8175-4a11-9bbf-412bb3835ae9"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:04.804715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=4 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:04.809696 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-46af2ace-4157-460c-a231-f79b41abf3c3 req-d963a8c6-d286-41d4-be8c-8647521f01ef service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:04.810635 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-46af2ace-4157-460c-a231-f79b41abf3c3 req-d963a8c6-d286-41d4-be8c-8647521f01ef service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:04.811314 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-46af2ace-4157-460c-a231-f79b41abf3c3 req-d963a8c6-d286-41d4-be8c-8647521f01ef service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:04.824285 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-46af2ace-4157-460c-a231-f79b41abf3c3 req-d963a8c6-d286-41d4-be8c-8647521f01ef service nova] Creating event network-vif-deleted:9fe34b5b-8175-4a11-9bbf-412bb3835ae9 for instance 864e44a6-db73-473d-967a-bb10611956d8 on hv-cinder-84773 Sep 08 14:10:04.829773 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-46af2ace-4157-460c-a231-f79b41abf3c3 req-d963a8c6-d286-41d4-be8c-8647521f01ef service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038632 Sep 08 14:10:04.830918 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 548/1099] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:05.796126 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:05.796760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:05.803915 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:05.804400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:05.804830 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:05.809457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:05.809457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:05.809457 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:05.839453 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:05.839933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:05.840365 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:05.840812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lazy-loading 'fault' on Instance uuid 864e44a6-db73-473d-967a-bb10611956d8 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:10:05.883431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:05.891848 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8235ada6-5e25-4098-b502-a42a53d5091c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 200 len: 1309 microversion: 2.1 time: 0.099619 Sep 08 14:10:05.892437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 552/1100] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:05 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:06.921121 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:06.921818 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 864e44a6-db73-473d-967a-bb10611956d8] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:06.928958 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:06.929439 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:06.929869 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:06.930621 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:06.931097 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:06.931515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:06.944578 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] HTTP exception thrown: Instance 864e44a6-db73-473d-967a-bb10611956d8 could not be found. Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Request method failure captured: Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 HTTP/1.1 Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGfdoCYumtY7awrAdh74duL_Y3tsp3Sb0gbprfkvL08sb61B15F9IUypwmXxqWmM6J-oUCGIzWMqVLpWZWBEIuoefk0trwKgNS4H50I0LQinS-sBFG96UfeC4ndjazvFt1CDJ_9GG3ddb6kfxWNudP0sXsIQ251YaYZJHqLp-iTbX2t4 Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: 736f37b101ed43369000a5ba9d93e90f Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-VolumesSnapshotTestJSON-642307126 Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:10:06.946766 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/736f37b101ed43369000a5ba9d93e90f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/736f37b101ed43369000a5ba9d93e90f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_736f37b101ed43369000a5ba9d93e90f", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/736f37b101ed43369000a5ba9d93e90f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-VolumesSnapshotTestJSON-642307126 Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: 736f37b101ed43369000a5ba9d93e90f Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-642307126 Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-VolumesSnapshotTestJSON-642307126-project Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 4ac5fd494df14ee1b0faf745dcc8c1e3 Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-VolumesSnapshotTestJSON-642307126-project Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 864e44a6-db73-473d-967a-bb10611956d8 could not be found. Sep 08 14:10:06.948573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '864e44a6-db73-473d-967a-bb10611956d8'} Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 864e44a6-db73-473d-967a-bb10611956d8 could not be found. Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:10:06.949478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 864e44a6-db73-473d-967a-bb10611956d8 could not be found. Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 864e44a6-db73-473d-967a-bb10611956d8 could not be found. Sep 08 14:10:06.959435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:10:06.960873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Returning 404 to user: Instance 864e44a6-db73-473d-967a-bb10611956d8 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:10:06.960873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-98132d42-8f75-48de-9951-cefc051c580e tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8" status: 404 len: 111 microversion: 2.1 time: 0.031822 Sep 08 14:10:06.960873 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 549/1101] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:06 2022] GET /compute/v2.1/servers/864e44a6-db73-473d-967a-bb10611956d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:10:17.393352 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-122061722", "imageRef": "e6fddbae-fff1-45a6-b79d-b73ee295e6fa", "flavorRef": "452", "networks": [{"uuid": "98e1279e-79e8-4a3f-8500-f2fed10455c8"}]}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:17.403248 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=10 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:17.403915 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:17.449695 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] validate_networks() for [('98e1279e-79e8-4a3f-8500-f2fed10455c8', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:10:17.812002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:10:17.812425 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:10:17.812897 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:10:17.813306 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:10:17.813716 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:10:17.823129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:17.823594 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:17.824021 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:17.824734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:17.825278 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:17.825699 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:17.842225 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Getting quotas for project 736f37b101ed43369000a5ba9d93e90f. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:10:17.846232 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Getting quotas for user 4ac5fd494df14ee1b0faf745dcc8c1e3 and project 736f37b101ed43369000a5ba9d93e90f. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:10:17.857038 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:10:17.859342 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6fddbae-fff1-45a6-b79d-b73ee295e6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:10:17.965277 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-70abf1a3-33f0-4058-843b-c9cabae1785c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575964 Sep 08 14:10:17.971433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 553/1102] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:10:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:10:17.978168 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-de5f6560-826f-4c9c-9334-afcf3e297592 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:17.984304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-de5f6560-826f-4c9c-9334-afcf3e297592 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:17.984304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:17.984304 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:18.038082 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-de5f6560-826f-4c9c-9334-afcf3e297592 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:18.046925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-de5f6560-826f-4c9c-9334-afcf3e297592 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1218 microversion: 2.1 time: 0.072764 Sep 08 14:10:18.059074 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 550/1103] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:17 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:18.782943 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1040636537", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-753369397", "security_groups": [{"name": "tempest-secgroup-smoke-1981503644"}], "block_device_mapping_v2": [{"uuid": "ddaca33b-5b83-4959-a54c-0ca5efe958d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3f20d1f7-5cf6-420f-b9b2-96be12e0ef13"}]}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:18.900433 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] validate_networks() for [('3f20d1f7-5cf6-420f-b9b2-96be12e0ef13', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:10:19.071777 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0e9d4eb1-58bd-42f9-9a37-2bc4a8e49ec9 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:19.072484 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0e9d4eb1-58bd-42f9-9a37-2bc4a8e49ec9 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:19.079819 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9d4eb1-58bd-42f9-9a37-2bc4a8e49ec9 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:19.080314 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9d4eb1-58bd-42f9-9a37-2bc4a8e49ec9 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:19.080752 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9d4eb1-58bd-42f9-9a37-2bc4a8e49ec9 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:19.081458 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9d4eb1-58bd-42f9-9a37-2bc4a8e49ec9 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:19.082029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9d4eb1-58bd-42f9-9a37-2bc4a8e49ec9 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:19.082339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0e9d4eb1-58bd-42f9-9a37-2bc4a8e49ec9 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:19.148675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0e9d4eb1-58bd-42f9-9a37-2bc4a8e49ec9 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:19.157934 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0e9d4eb1-58bd-42f9-9a37-2bc4a8e49ec9 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1222 microversion: 2.1 time: 0.091351 Sep 08 14:10:19.159141 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 551/1104] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:19 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:10:19.562239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:10:19.562734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:10:19.563549 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:10:19.564007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:10:19.564571 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:10:19.573562 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:19.578428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:19.578428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:19.578428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:19.578428 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:19.578810 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:19.594273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Getting quotas for project f7224a31a8aa4e7ca9514d77b5f00526. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:10:19.598856 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Getting quotas for user 4b8776b82114444cbe35aa534fe14fa2 and project f7224a31a8aa4e7ca9514d77b5f00526. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:10:19.661878 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:10:19.664493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddaca33b-5b83-4959-a54c-0ca5efe958d8',volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:10:20.044631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4071b040-71c0-4e19-ab44-36ca6e9df107 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.266107 Sep 08 14:10:20.046108 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 554/1105] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:10:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:10:20.057872 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-38c76fbe-d3d7-423f-8586-6f2a0214c719 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:20.058505 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-38c76fbe-d3d7-423f-8586-6f2a0214c719 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:20.118825 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-38c76fbe-d3d7-423f-8586-6f2a0214c719 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:20.126352 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-38c76fbe-d3d7-423f-8586-6f2a0214c719 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1094 microversion: 2.1 time: 0.073110 Sep 08 14:10:20.127000 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 552/1106] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:20 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:20.185217 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e7b1c6ad-bd58-4241-a41b-72e5a9aeb027 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:20.185824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e7b1c6ad-bd58-4241-a41b-72e5a9aeb027 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:20.193534 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7b1c6ad-bd58-4241-a41b-72e5a9aeb027 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:20.193954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7b1c6ad-bd58-4241-a41b-72e5a9aeb027 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:20.194380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7b1c6ad-bd58-4241-a41b-72e5a9aeb027 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:20.195096 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7b1c6ad-bd58-4241-a41b-72e5a9aeb027 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:20.195722 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7b1c6ad-bd58-4241-a41b-72e5a9aeb027 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:20.196140 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e7b1c6ad-bd58-4241-a41b-72e5a9aeb027 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:20.315376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e7b1c6ad-bd58-4241-a41b-72e5a9aeb027 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:20.326717 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e7b1c6ad-bd58-4241-a41b-72e5a9aeb027 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1278 microversion: 2.1 time: 0.145434 Sep 08 14:10:20.327339 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 555/1107] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:20 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:21.150271 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-647950e7-4ad5-4f09-b3b2-9748a6fb1712 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:21.150876 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-647950e7-4ad5-4f09-b3b2-9748a6fb1712 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:21.159085 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-647950e7-4ad5-4f09-b3b2-9748a6fb1712 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:21.159573 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-647950e7-4ad5-4f09-b3b2-9748a6fb1712 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:21.160199 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-647950e7-4ad5-4f09-b3b2-9748a6fb1712 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:21.160888 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-647950e7-4ad5-4f09-b3b2-9748a6fb1712 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:21.161339 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-647950e7-4ad5-4f09-b3b2-9748a6fb1712 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:21.161764 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-647950e7-4ad5-4f09-b3b2-9748a6fb1712 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:21.227001 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-647950e7-4ad5-4f09-b3b2-9748a6fb1712 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:21.236671 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-647950e7-4ad5-4f09-b3b2-9748a6fb1712 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1144 microversion: 2.1 time: 0.090246 Sep 08 14:10:21.237255 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 553/1108] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:21 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:21.349649 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-2765eb09-e010-4863-adec-9f301bff0578 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:21.350261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-2765eb09-e010-4863-adec-9f301bff0578 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:21.357304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2765eb09-e010-4863-adec-9f301bff0578 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:21.357533 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2765eb09-e010-4863-adec-9f301bff0578 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:21.357820 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2765eb09-e010-4863-adec-9f301bff0578 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:21.358531 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2765eb09-e010-4863-adec-9f301bff0578 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:21.359014 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2765eb09-e010-4863-adec-9f301bff0578 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:21.359429 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-2765eb09-e010-4863-adec-9f301bff0578 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:21.609022 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-2765eb09-e010-4863-adec-9f301bff0578 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:21.618172 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-2765eb09-e010-4863-adec-9f301bff0578 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1318 microversion: 2.1 time: 0.272337 Sep 08 14:10:21.618760 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 556/1109] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:21 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:22.154351 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-31065a9e-3449-40e5-96e4-ce703fd810d5 req-54f80b2b-740c-4cae-a450-2e39331ad9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c98510c-ee3a-4107-b285-117b8425a026", "tag": "897dd128-96c5-409b-8c2a-d4b1f57bcd8b"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:22.164845 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-31065a9e-3449-40e5-96e4-ce703fd810d5 req-54f80b2b-740c-4cae-a450-2e39331ad9b9 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:22.165318 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-31065a9e-3449-40e5-96e4-ce703fd810d5 req-54f80b2b-740c-4cae-a450-2e39331ad9b9 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:22.165739 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-31065a9e-3449-40e5-96e4-ce703fd810d5 req-54f80b2b-740c-4cae-a450-2e39331ad9b9 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:22.177596 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-31065a9e-3449-40e5-96e4-ce703fd810d5 req-54f80b2b-740c-4cae-a450-2e39331ad9b9 service nova] Creating event network-changed:897dd128-96c5-409b-8c2a-d4b1f57bcd8b for instance 1c98510c-ee3a-4107-b285-117b8425a026 on hv-cinder-84773 Sep 08 14:10:22.184146 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-31065a9e-3449-40e5-96e4-ce703fd810d5 req-54f80b2b-740c-4cae-a450-2e39331ad9b9 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033594 Sep 08 14:10:22.184794 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 554/1110] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:10:22.259717 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b63c4243-d3e5-448f-84a5-69c6a4270906 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:22.260323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b63c4243-d3e5-448f-84a5-69c6a4270906 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:22.266442 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b63c4243-d3e5-448f-84a5-69c6a4270906 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:22.266951 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b63c4243-d3e5-448f-84a5-69c6a4270906 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:22.267400 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b63c4243-d3e5-448f-84a5-69c6a4270906 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:22.268092 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b63c4243-d3e5-448f-84a5-69c6a4270906 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:22.268901 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b63c4243-d3e5-448f-84a5-69c6a4270906 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:22.269317 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b63c4243-d3e5-448f-84a5-69c6a4270906 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:22.353133 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b63c4243-d3e5-448f-84a5-69c6a4270906 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:22.361492 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b63c4243-d3e5-448f-84a5-69c6a4270906 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1192 microversion: 2.1 time: 0.105616 Sep 08 14:10:22.362072 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 557/1111] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:22 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:22.642229 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-80743bed-d8e7-442d-888e-dcefc49f0683 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:22.642977 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-80743bed-d8e7-442d-888e-dcefc49f0683 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:22.650211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-80743bed-d8e7-442d-888e-dcefc49f0683 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:22.650211 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-80743bed-d8e7-442d-888e-dcefc49f0683 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:22.650659 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-80743bed-d8e7-442d-888e-dcefc49f0683 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:22.651387 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-80743bed-d8e7-442d-888e-dcefc49f0683 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:22.651841 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-80743bed-d8e7-442d-888e-dcefc49f0683 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:22.652265 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-80743bed-d8e7-442d-888e-dcefc49f0683 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:22.883270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-80743bed-d8e7-442d-888e-dcefc49f0683 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:22.893044 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-80743bed-d8e7-442d-888e-dcefc49f0683 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1318 microversion: 2.1 time: 0.254953 Sep 08 14:10:22.894755 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 555/1112] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:22 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:23.388464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-41055952-383b-4529-9201-4c06331f23ec tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:23.389109 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-41055952-383b-4529-9201-4c06331f23ec tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:23.396324 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41055952-383b-4529-9201-4c06331f23ec tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:23.396809 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41055952-383b-4529-9201-4c06331f23ec tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:23.397245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41055952-383b-4529-9201-4c06331f23ec tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:23.397944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41055952-383b-4529-9201-4c06331f23ec tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:23.398394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41055952-383b-4529-9201-4c06331f23ec tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:23.398814 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-41055952-383b-4529-9201-4c06331f23ec tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:23.540976 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-41055952-383b-4529-9201-4c06331f23ec tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:23.551958 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-41055952-383b-4529-9201-4c06331f23ec tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1278 microversion: 2.1 time: 0.167461 Sep 08 14:10:23.552805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 558/1113] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:23 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:23.920090 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-3830e7a7-9c65-4065-9391-a5bd2318bc0a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:23.920700 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-3830e7a7-9c65-4065-9391-a5bd2318bc0a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:23.927784 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3830e7a7-9c65-4065-9391-a5bd2318bc0a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:23.928262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3830e7a7-9c65-4065-9391-a5bd2318bc0a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:23.928688 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3830e7a7-9c65-4065-9391-a5bd2318bc0a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:23.929366 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3830e7a7-9c65-4065-9391-a5bd2318bc0a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:23.929812 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3830e7a7-9c65-4065-9391-a5bd2318bc0a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:23.930228 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-3830e7a7-9c65-4065-9391-a5bd2318bc0a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:24.059906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-3830e7a7-9c65-4065-9391-a5bd2318bc0a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:24.068253 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-3830e7a7-9c65-4065-9391-a5bd2318bc0a tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1318 microversion: 2.1 time: 0.153059 Sep 08 14:10:24.068822 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 556/1114] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:23 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:24.576829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-260a3091-fc48-4c41-beb4-b8e6674b39a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:24.577380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-260a3091-fc48-4c41-beb4-b8e6674b39a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:24.584471 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-260a3091-fc48-4c41-beb4-b8e6674b39a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:24.584959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-260a3091-fc48-4c41-beb4-b8e6674b39a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:24.585403 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-260a3091-fc48-4c41-beb4-b8e6674b39a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:24.586168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-260a3091-fc48-4c41-beb4-b8e6674b39a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:24.586624 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-260a3091-fc48-4c41-beb4-b8e6674b39a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:24.587077 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-260a3091-fc48-4c41-beb4-b8e6674b39a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:24.728999 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-260a3091-fc48-4c41-beb4-b8e6674b39a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:24.737145 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-260a3091-fc48-4c41-beb4-b8e6674b39a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1278 microversion: 2.1 time: 0.164503 Sep 08 14:10:24.737963 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 559/1115] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:24 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:25.091268 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d9a7cce4-f99e-476e-9764-03d10ee1a267 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:25.092179 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d9a7cce4-f99e-476e-9764-03d10ee1a267 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:25.099054 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9a7cce4-f99e-476e-9764-03d10ee1a267 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:25.099576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9a7cce4-f99e-476e-9764-03d10ee1a267 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:25.100182 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9a7cce4-f99e-476e-9764-03d10ee1a267 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:25.100979 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9a7cce4-f99e-476e-9764-03d10ee1a267 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:25.101509 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9a7cce4-f99e-476e-9764-03d10ee1a267 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:25.102120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d9a7cce4-f99e-476e-9764-03d10ee1a267 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:25.294994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-ec9f35cb-1342-435d-a950-1781a5b5cc3b req-fe8f70a0-7321-4a14-b665-c70d3c1f2e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f355c07f-03f5-463b-b66b-2b025743ad30", "tag": "2ce643bd-a09a-48f1-b96a-6fac0788afc9"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:25.297413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d9a7cce4-f99e-476e-9764-03d10ee1a267 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:25.310529 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-ec9f35cb-1342-435d-a950-1781a5b5cc3b req-fe8f70a0-7321-4a14-b665-c70d3c1f2e64 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:25.311349 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-ec9f35cb-1342-435d-a950-1781a5b5cc3b req-fe8f70a0-7321-4a14-b665-c70d3c1f2e64 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:25.312208 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-ec9f35cb-1342-435d-a950-1781a5b5cc3b req-fe8f70a0-7321-4a14-b665-c70d3c1f2e64 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:25.313205 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d9a7cce4-f99e-476e-9764-03d10ee1a267 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1318 microversion: 2.1 time: 0.225153 Sep 08 14:10:25.314804 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 557/1116] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:25 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:25.326434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-ec9f35cb-1342-435d-a950-1781a5b5cc3b req-fe8f70a0-7321-4a14-b665-c70d3c1f2e64 service nova] Creating event network-changed:2ce643bd-a09a-48f1-b96a-6fac0788afc9 for instance f355c07f-03f5-463b-b66b-2b025743ad30 on hv-cinder-84773 Sep 08 14:10:25.334247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-ec9f35cb-1342-435d-a950-1781a5b5cc3b req-fe8f70a0-7321-4a14-b665-c70d3c1f2e64 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108826 Sep 08 14:10:25.334247 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 560/1117] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:25.760006 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f30f28ed-6e99-4723-ac5b-60206d4ff996 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:25.760707 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f30f28ed-6e99-4723-ac5b-60206d4ff996 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:25.766823 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f30f28ed-6e99-4723-ac5b-60206d4ff996 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:25.767882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f30f28ed-6e99-4723-ac5b-60206d4ff996 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:25.767882 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f30f28ed-6e99-4723-ac5b-60206d4ff996 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:25.769895 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f30f28ed-6e99-4723-ac5b-60206d4ff996 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:25.770545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f30f28ed-6e99-4723-ac5b-60206d4ff996 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:25.771184 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f30f28ed-6e99-4723-ac5b-60206d4ff996 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:25.916349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f30f28ed-6e99-4723-ac5b-60206d4ff996 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:25.924954 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f30f28ed-6e99-4723-ac5b-60206d4ff996 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1266 microversion: 2.1 time: 0.168943 Sep 08 14:10:25.925521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 558/1118] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:25 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:26.339096 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7240fa8e-fa7f-4007-b35c-e74322b72351 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:26.339925 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7240fa8e-fa7f-4007-b35c-e74322b72351 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:26.346656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7240fa8e-fa7f-4007-b35c-e74322b72351 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:26.347162 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7240fa8e-fa7f-4007-b35c-e74322b72351 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:26.347593 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7240fa8e-fa7f-4007-b35c-e74322b72351 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:26.348284 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7240fa8e-fa7f-4007-b35c-e74322b72351 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:26.348732 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7240fa8e-fa7f-4007-b35c-e74322b72351 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:26.349164 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7240fa8e-fa7f-4007-b35c-e74322b72351 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:26.485731 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7240fa8e-fa7f-4007-b35c-e74322b72351 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:26.494235 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7240fa8e-fa7f-4007-b35c-e74322b72351 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1318 microversion: 2.1 time: 0.160626 Sep 08 14:10:26.496501 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 561/1119] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:26 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:26.947348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-92b093ec-459b-444a-8b04-ab40a8f8a156 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:26.947961 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-92b093ec-459b-444a-8b04-ab40a8f8a156 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:26.954578 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92b093ec-459b-444a-8b04-ab40a8f8a156 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:26.955107 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92b093ec-459b-444a-8b04-ab40a8f8a156 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:26.955550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92b093ec-459b-444a-8b04-ab40a8f8a156 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:26.956248 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92b093ec-459b-444a-8b04-ab40a8f8a156 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:26.956707 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92b093ec-459b-444a-8b04-ab40a8f8a156 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:26.957131 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-92b093ec-459b-444a-8b04-ab40a8f8a156 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:27.095535 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-3ce55448-3c1c-40e9-876f-e3412bdf9ceb req-0554ab23-3c06-4bcf-9b7b-600e3ae2dfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c98510c-ee3a-4107-b285-117b8425a026", "name": "network-vif-plugged", "status": "completed", "tag": "897dd128-96c5-409b-8c2a-d4b1f57bcd8b"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:27.100671 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-92b093ec-459b-444a-8b04-ab40a8f8a156 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:27.107961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-3ce55448-3c1c-40e9-876f-e3412bdf9ceb req-0554ab23-3c06-4bcf-9b7b-600e3ae2dfd3 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:27.108672 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-92b093ec-459b-444a-8b04-ab40a8f8a156 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1266 microversion: 2.1 time: 0.165504 Sep 08 14:10:27.108808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-3ce55448-3c1c-40e9-876f-e3412bdf9ceb req-0554ab23-3c06-4bcf-9b7b-600e3ae2dfd3 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:27.109255 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 559/1120] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:26 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:27.109394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-3ce55448-3c1c-40e9-876f-e3412bdf9ceb req-0554ab23-3c06-4bcf-9b7b-600e3ae2dfd3 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:27.128135 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-3ce55448-3c1c-40e9-876f-e3412bdf9ceb req-0554ab23-3c06-4bcf-9b7b-600e3ae2dfd3 service nova] Creating event network-vif-plugged:897dd128-96c5-409b-8c2a-d4b1f57bcd8b for instance 1c98510c-ee3a-4107-b285-117b8425a026 on hv-cinder-84773 Sep 08 14:10:27.128135 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-3ce55448-3c1c-40e9-876f-e3412bdf9ceb req-0554ab23-3c06-4bcf-9b7b-600e3ae2dfd3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035235 Sep 08 14:10:27.128574 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 562/1121] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:10:27.517615 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-0457950a-8f20-4824-b6bb-de2c40e7623c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:27.518217 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-0457950a-8f20-4824-b6bb-de2c40e7623c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:27.525036 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0457950a-8f20-4824-b6bb-de2c40e7623c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:27.525517 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0457950a-8f20-4824-b6bb-de2c40e7623c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:27.525954 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0457950a-8f20-4824-b6bb-de2c40e7623c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:27.526651 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0457950a-8f20-4824-b6bb-de2c40e7623c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:27.527121 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0457950a-8f20-4824-b6bb-de2c40e7623c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:27.527542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-0457950a-8f20-4824-b6bb-de2c40e7623c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:27.662384 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-0457950a-8f20-4824-b6bb-de2c40e7623c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:27.670277 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-0457950a-8f20-4824-b6bb-de2c40e7623c tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1318 microversion: 2.1 time: 0.156559 Sep 08 14:10:27.670849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 560/1122] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:27 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:28.132182 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-7df807d2-a52e-4587-8ae3-72786735fb9f tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:28.132896 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-7df807d2-a52e-4587-8ae3-72786735fb9f tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:28.140281 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df807d2-a52e-4587-8ae3-72786735fb9f tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:28.140771 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df807d2-a52e-4587-8ae3-72786735fb9f tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:28.141206 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df807d2-a52e-4587-8ae3-72786735fb9f tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:28.141911 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df807d2-a52e-4587-8ae3-72786735fb9f tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:28.142367 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df807d2-a52e-4587-8ae3-72786735fb9f tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:28.142792 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-7df807d2-a52e-4587-8ae3-72786735fb9f tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:28.281950 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-7df807d2-a52e-4587-8ae3-72786735fb9f tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:28.289756 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-7df807d2-a52e-4587-8ae3-72786735fb9f tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1266 microversion: 2.1 time: 0.162611 Sep 08 14:10:28.290320 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 563/1123] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:28 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:28.693135 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d8b5aa57-01c2-4e3b-837a-4b8fd2aa800d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:28.693774 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d8b5aa57-01c2-4e3b-837a-4b8fd2aa800d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:28.700291 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8b5aa57-01c2-4e3b-837a-4b8fd2aa800d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:28.700777 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8b5aa57-01c2-4e3b-837a-4b8fd2aa800d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:28.701215 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8b5aa57-01c2-4e3b-837a-4b8fd2aa800d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:28.701905 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8b5aa57-01c2-4e3b-837a-4b8fd2aa800d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:28.702363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8b5aa57-01c2-4e3b-837a-4b8fd2aa800d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:28.702790 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d8b5aa57-01c2-4e3b-837a-4b8fd2aa800d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:28.834272 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d8b5aa57-01c2-4e3b-837a-4b8fd2aa800d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:28.841387 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d8b5aa57-01c2-4e3b-837a-4b8fd2aa800d tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1318 microversion: 2.1 time: 0.152156 Sep 08 14:10:28.841950 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 561/1124] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:28 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:29.313261 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-8c709bfe-a655-46fe-8ad5-8c9afb6d7733 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:29.313902 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-8c709bfe-a655-46fe-8ad5-8c9afb6d7733 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:29.320865 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-a655-46fe-8ad5-8c9afb6d7733 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:29.321358 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-a655-46fe-8ad5-8c9afb6d7733 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:29.321799 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-a655-46fe-8ad5-8c9afb6d7733 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:29.322523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-a655-46fe-8ad5-8c9afb6d7733 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:29.323010 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-a655-46fe-8ad5-8c9afb6d7733 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:29.323435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-a655-46fe-8ad5-8c9afb6d7733 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:29.455357 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-8c709bfe-a655-46fe-8ad5-8c9afb6d7733 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:29.463137 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-8c709bfe-a655-46fe-8ad5-8c9afb6d7733 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1266 microversion: 2.1 time: 0.154046 Sep 08 14:10:29.463714 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 564/1125] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:29 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:29.864747 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4d75f075-2dcc-46c0-bc4e-bb1a30f461ff tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:29.865349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4d75f075-2dcc-46c0-bc4e-bb1a30f461ff tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:29.871925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d75f075-2dcc-46c0-bc4e-bb1a30f461ff tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:29.872414 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d75f075-2dcc-46c0-bc4e-bb1a30f461ff tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:29.872851 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d75f075-2dcc-46c0-bc4e-bb1a30f461ff tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:29.873544 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d75f075-2dcc-46c0-bc4e-bb1a30f461ff tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:29.873997 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d75f075-2dcc-46c0-bc4e-bb1a30f461ff tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:29.874422 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4d75f075-2dcc-46c0-bc4e-bb1a30f461ff tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:30.004428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4d75f075-2dcc-46c0-bc4e-bb1a30f461ff tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:30.012203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4d75f075-2dcc-46c0-bc4e-bb1a30f461ff tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1506 microversion: 2.1 time: 0.151456 Sep 08 14:10:30.012772 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 562/1126] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:29 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:30.035585 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-aec4d8f3-1073-499d-8eba-8810f989bc1b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6c4d505-a75a-4b1e-9fdd-93254746ddbf", "device": "/dev/sdb"}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:30.038572 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-aec4d8f3-1073-499d-8eba-8810f989bc1b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:30.040631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=4 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:30.041393 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=12 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:30.045979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aec4d8f3-1073-499d-8eba-8810f989bc1b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:30.046454 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aec4d8f3-1073-499d-8eba-8810f989bc1b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:30.046904 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aec4d8f3-1073-499d-8eba-8810f989bc1b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:30.047596 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aec4d8f3-1073-499d-8eba-8810f989bc1b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:30.048039 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aec4d8f3-1073-499d-8eba-8810f989bc1b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:30.048455 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-aec4d8f3-1073-499d-8eba-8810f989bc1b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:30.486348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-1e60cb9d-50f3-498a-af31-0a0b9f74e7c3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:30.494259 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-1e60cb9d-50f3-498a-af31-0a0b9f74e7c3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:30.494259 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=4 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:30.494259 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e60cb9d-50f3-498a-af31-0a0b9f74e7c3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:30.496025 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e60cb9d-50f3-498a-af31-0a0b9f74e7c3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:30.496025 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e60cb9d-50f3-498a-af31-0a0b9f74e7c3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:30.496025 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e60cb9d-50f3-498a-af31-0a0b9f74e7c3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:30.497000 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e60cb9d-50f3-498a-af31-0a0b9f74e7c3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:30.497000 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-1e60cb9d-50f3-498a-af31-0a0b9f74e7c3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:30.643194 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-1e60cb9d-50f3-498a-af31-0a0b9f74e7c3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:30.652301 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-1e60cb9d-50f3-498a-af31-0a0b9f74e7c3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1266 microversion: 2.1 time: 0.169810 Sep 08 14:10:30.652964 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 563/1127] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:30 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:30.845842 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-aec4d8f3-1073-499d-8eba-8810f989bc1b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "POST /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814379 Sep 08 14:10:30.847058 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 565/1128] 10.222.0.91 () {60 vars in 1323 bytes} [Thu Sep 8 14:10:30 2022] POST /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:31.679270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4aa0c7ef-aa41-4672-bf0d-39ba56366b19 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:31.680382 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4aa0c7ef-aa41-4672-bf0d-39ba56366b19 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:31.689676 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4aa0c7ef-aa41-4672-bf0d-39ba56366b19 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:31.690171 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4aa0c7ef-aa41-4672-bf0d-39ba56366b19 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:31.690608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4aa0c7ef-aa41-4672-bf0d-39ba56366b19 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:31.691438 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4aa0c7ef-aa41-4672-bf0d-39ba56366b19 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:31.692374 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4aa0c7ef-aa41-4672-bf0d-39ba56366b19 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:31.692807 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4aa0c7ef-aa41-4672-bf0d-39ba56366b19 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:31.830180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4aa0c7ef-aa41-4672-bf0d-39ba56366b19 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:31.839522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4aa0c7ef-aa41-4672-bf0d-39ba56366b19 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1266 microversion: 2.1 time: 0.167164 Sep 08 14:10:31.840166 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 564/1129] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:31 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:32.863697 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9884e088-a3f5-4d0c-9772-26fb8c492cfb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:32.864979 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9884e088-a3f5-4d0c-9772-26fb8c492cfb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:32.871328 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9884e088-a3f5-4d0c-9772-26fb8c492cfb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:32.871816 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9884e088-a3f5-4d0c-9772-26fb8c492cfb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:32.872254 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9884e088-a3f5-4d0c-9772-26fb8c492cfb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:32.872951 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9884e088-a3f5-4d0c-9772-26fb8c492cfb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:32.873409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9884e088-a3f5-4d0c-9772-26fb8c492cfb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:32.873836 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9884e088-a3f5-4d0c-9772-26fb8c492cfb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:33.017335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-9884e088-a3f5-4d0c-9772-26fb8c492cfb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:33.026690 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9884e088-a3f5-4d0c-9772-26fb8c492cfb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1266 microversion: 2.1 time: 0.167525 Sep 08 14:10:33.033546 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 566/1130] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:32 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:34.053932 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c0dca081-3152-44e7-ba27-94d17fc2e5e7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:34.055061 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c0dca081-3152-44e7-ba27-94d17fc2e5e7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:34.065091 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c0dca081-3152-44e7-ba27-94d17fc2e5e7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:34.065587 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c0dca081-3152-44e7-ba27-94d17fc2e5e7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:34.066023 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c0dca081-3152-44e7-ba27-94d17fc2e5e7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:34.066726 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c0dca081-3152-44e7-ba27-94d17fc2e5e7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:34.067214 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c0dca081-3152-44e7-ba27-94d17fc2e5e7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:34.067634 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c0dca081-3152-44e7-ba27-94d17fc2e5e7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:34.217328 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c0dca081-3152-44e7-ba27-94d17fc2e5e7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:34.226171 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c0dca081-3152-44e7-ba27-94d17fc2e5e7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1266 microversion: 2.1 time: 0.179873 Sep 08 14:10:34.226755 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 565/1131] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:34 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:35.160834 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-bf5e8c29-e688-466a-a2dd-cf7325bdd576 req-2d0b58c2-8a5d-4c62-b6af-af6473fd3464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f355c07f-03f5-463b-b66b-2b025743ad30", "name": "network-vif-plugged", "status": "completed", "tag": "2ce643bd-a09a-48f1-b96a-6fac0788afc9"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:35.172184 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-bf5e8c29-e688-466a-a2dd-cf7325bdd576 req-2d0b58c2-8a5d-4c62-b6af-af6473fd3464 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:35.172666 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-bf5e8c29-e688-466a-a2dd-cf7325bdd576 req-2d0b58c2-8a5d-4c62-b6af-af6473fd3464 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:35.173094 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-bf5e8c29-e688-466a-a2dd-cf7325bdd576 req-2d0b58c2-8a5d-4c62-b6af-af6473fd3464 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:35.184808 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-bf5e8c29-e688-466a-a2dd-cf7325bdd576 req-2d0b58c2-8a5d-4c62-b6af-af6473fd3464 service nova] Creating event network-vif-plugged:2ce643bd-a09a-48f1-b96a-6fac0788afc9 for instance f355c07f-03f5-463b-b66b-2b025743ad30 on hv-cinder-84773 Sep 08 14:10:35.189753 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-bf5e8c29-e688-466a-a2dd-cf7325bdd576 req-2d0b58c2-8a5d-4c62-b6af-af6473fd3464 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033720 Sep 08 14:10:35.190334 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 567/1132] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:35.249531 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4cb2e520-5333-48e7-aabb-c4fa5bbdea51 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:35.250120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4cb2e520-5333-48e7-aabb-c4fa5bbdea51 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:35.256945 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb2e520-5333-48e7-aabb-c4fa5bbdea51 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:35.257682 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb2e520-5333-48e7-aabb-c4fa5bbdea51 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:35.258342 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb2e520-5333-48e7-aabb-c4fa5bbdea51 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:35.259255 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb2e520-5333-48e7-aabb-c4fa5bbdea51 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:35.259918 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb2e520-5333-48e7-aabb-c4fa5bbdea51 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:35.260310 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4cb2e520-5333-48e7-aabb-c4fa5bbdea51 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:35.400157 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-4cb2e520-5333-48e7-aabb-c4fa5bbdea51 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:35.408460 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4cb2e520-5333-48e7-aabb-c4fa5bbdea51 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1266 microversion: 2.1 time: 0.163357 Sep 08 14:10:35.409100 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 566/1133] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:35 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:36.432397 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-34c6f361-1171-4565-b2dd-75c18db1169d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:36.433100 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-34c6f361-1171-4565-b2dd-75c18db1169d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:36.439366 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34c6f361-1171-4565-b2dd-75c18db1169d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:36.439860 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34c6f361-1171-4565-b2dd-75c18db1169d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:36.440297 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34c6f361-1171-4565-b2dd-75c18db1169d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:36.440992 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34c6f361-1171-4565-b2dd-75c18db1169d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:36.441449 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34c6f361-1171-4565-b2dd-75c18db1169d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:36.441876 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-34c6f361-1171-4565-b2dd-75c18db1169d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:36.578484 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-34c6f361-1171-4565-b2dd-75c18db1169d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:36.586346 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-34c6f361-1171-4565-b2dd-75c18db1169d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1266 microversion: 2.1 time: 0.158865 Sep 08 14:10:36.586940 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 568/1134] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:36 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:37.609298 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e328ca4e-271f-4a98-8cb8-68192f53d5f7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:37.609895 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e328ca4e-271f-4a98-8cb8-68192f53d5f7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:37.616589 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e328ca4e-271f-4a98-8cb8-68192f53d5f7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:37.617083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e328ca4e-271f-4a98-8cb8-68192f53d5f7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:37.617582 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e328ca4e-271f-4a98-8cb8-68192f53d5f7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:37.618269 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e328ca4e-271f-4a98-8cb8-68192f53d5f7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:37.618724 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e328ca4e-271f-4a98-8cb8-68192f53d5f7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:37.619173 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e328ca4e-271f-4a98-8cb8-68192f53d5f7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:37.755083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-e328ca4e-271f-4a98-8cb8-68192f53d5f7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:37.763850 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e328ca4e-271f-4a98-8cb8-68192f53d5f7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1452 microversion: 2.1 time: 0.158592 Sep 08 14:10:37.766060 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 567/1135] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:37 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:37.788521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-25597d21-74fe-4768-bb89-ec3d1b12bef9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:37.789168 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-25597d21-74fe-4768-bb89-ec3d1b12bef9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:37.795752 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-25597d21-74fe-4768-bb89-ec3d1b12bef9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:37.796242 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-25597d21-74fe-4768-bb89-ec3d1b12bef9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:37.796676 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-25597d21-74fe-4768-bb89-ec3d1b12bef9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:37.797367 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-25597d21-74fe-4768-bb89-ec3d1b12bef9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:37.797820 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-25597d21-74fe-4768-bb89-ec3d1b12bef9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:37.798437 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-25597d21-74fe-4768-bb89-ec3d1b12bef9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:37.929568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-25597d21-74fe-4768-bb89-ec3d1b12bef9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:37.937302 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-25597d21-74fe-4768-bb89-ec3d1b12bef9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1452 microversion: 2.1 time: 0.152712 Sep 08 14:10:37.937866 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 569/1136] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:37 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:40.073556 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-4e626d51-058b-4681-9e37-4ed664ec61fd req-7e2be381-4829-4e48-9b5e-4877da191c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f355c07f-03f5-463b-b66b-2b025743ad30", "tag": "2ce643bd-a09a-48f1-b96a-6fac0788afc9"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:40.073556 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-4e626d51-058b-4681-9e37-4ed664ec61fd req-7e2be381-4829-4e48-9b5e-4877da191c0c service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:40.073556 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-4e626d51-058b-4681-9e37-4ed664ec61fd req-7e2be381-4829-4e48-9b5e-4877da191c0c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:40.073556 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-4e626d51-058b-4681-9e37-4ed664ec61fd req-7e2be381-4829-4e48-9b5e-4877da191c0c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:40.084515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-4e626d51-058b-4681-9e37-4ed664ec61fd req-7e2be381-4829-4e48-9b5e-4877da191c0c service nova] Creating event network-changed:2ce643bd-a09a-48f1-b96a-6fac0788afc9 for instance f355c07f-03f5-463b-b66b-2b025743ad30 on hv-cinder-84773 Sep 08 14:10:40.089490 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-4e626d51-058b-4681-9e37-4ed664ec61fd req-7e2be381-4829-4e48-9b5e-4877da191c0c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089421 Sep 08 14:10:40.090255 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 568/1137] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:47.938781 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-01a10762-009f-41d3-87fd-493ff345a65b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:47.939348 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-01a10762-009f-41d3-87fd-493ff345a65b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:47.941919 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-2dd0e245-a5b8-4b34-984e-d82415651c42 req-6471a63b-bb5a-4caf-8682-b2c331ed8687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e11d590-d8c5-4b4a-ba5d-0a0ae203954b", "tag": "2bb33aac-6854-44c1-9bf8-4f4c73e872c4"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:47.942333 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:47.943817 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:47.949083 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a10762-009f-41d3-87fd-493ff345a65b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:47.954994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a10762-009f-41d3-87fd-493ff345a65b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:47.954994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a10762-009f-41d3-87fd-493ff345a65b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:47.954994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a10762-009f-41d3-87fd-493ff345a65b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:47.954994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a10762-009f-41d3-87fd-493ff345a65b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:47.955491 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01a10762-009f-41d3-87fd-493ff345a65b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:47.955596 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2dd0e245-a5b8-4b34-984e-d82415651c42 req-6471a63b-bb5a-4caf-8682-b2c331ed8687 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:47.955596 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2dd0e245-a5b8-4b34-984e-d82415651c42 req-6471a63b-bb5a-4caf-8682-b2c331ed8687 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:47.955596 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-2dd0e245-a5b8-4b34-984e-d82415651c42 req-6471a63b-bb5a-4caf-8682-b2c331ed8687 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:47.964967 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-2dd0e245-a5b8-4b34-984e-d82415651c42 req-6471a63b-bb5a-4caf-8682-b2c331ed8687 service nova] Creating event network-changed:2bb33aac-6854-44c1-9bf8-4f4c73e872c4 for instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b on hv-cinder-84773 Sep 08 14:10:47.970245 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-2dd0e245-a5b8-4b34-984e-d82415651c42 req-6471a63b-bb5a-4caf-8682-b2c331ed8687 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032846 Sep 08 14:10:47.971171 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 569/1138] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:47.982194 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-01a10762-009f-41d3-87fd-493ff345a65b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Going to try to terminate instance {{(pid=133059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:10:48.367662 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-01a10762-009f-41d3-87fd-493ff345a65b tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "DELETE /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 204 len: 0 microversion: 2.1 time: 0.432521 Sep 08 14:10:48.368492 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 570/1139] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:10:47 2022] DELETE /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:10:48.377489 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5f8307b5-7d69-4a3e-9ccd-e46f4bfbb6b3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:48.378180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5f8307b5-7d69-4a3e-9ccd-e46f4bfbb6b3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:48.385162 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f8307b5-7d69-4a3e-9ccd-e46f4bfbb6b3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:48.385649 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f8307b5-7d69-4a3e-9ccd-e46f4bfbb6b3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:48.386087 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f8307b5-7d69-4a3e-9ccd-e46f4bfbb6b3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:48.386781 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f8307b5-7d69-4a3e-9ccd-e46f4bfbb6b3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:48.387270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f8307b5-7d69-4a3e-9ccd-e46f4bfbb6b3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:48.387695 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5f8307b5-7d69-4a3e-9ccd-e46f4bfbb6b3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:48.407782 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=100 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:48.542434 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5f8307b5-7d69-4a3e-9ccd-e46f4bfbb6b3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:48.553940 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5f8307b5-7d69-4a3e-9ccd-e46f4bfbb6b3 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.180495 Sep 08 14:10:48.565494 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 570/1140] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:48 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:10:49.581025 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-20c074b9-9ddb-4e8a-bdb7-f901b832705d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:49.581725 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-20c074b9-9ddb-4e8a-bdb7-f901b832705d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:49.588559 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c074b9-9ddb-4e8a-bdb7-f901b832705d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:49.589037 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c074b9-9ddb-4e8a-bdb7-f901b832705d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:49.589466 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c074b9-9ddb-4e8a-bdb7-f901b832705d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:49.590177 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c074b9-9ddb-4e8a-bdb7-f901b832705d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:49.590620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c074b9-9ddb-4e8a-bdb7-f901b832705d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:49.591071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-20c074b9-9ddb-4e8a-bdb7-f901b832705d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:49.740918 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-20c074b9-9ddb-4e8a-bdb7-f901b832705d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:49.743294 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-20c074b9-9ddb-4e8a-bdb7-f901b832705d tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1568 microversion: 2.1 time: 0.166414 Sep 08 14:10:49.744129 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 571/1141] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:49 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:50.777301 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5c17ad27-dde6-4a04-a833-aa9209889391 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:50.780757 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5c17ad27-dde6-4a04-a833-aa9209889391 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:50.780757 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=47 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:50.785756 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c17ad27-dde6-4a04-a833-aa9209889391 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:50.786486 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c17ad27-dde6-4a04-a833-aa9209889391 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:50.787821 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c17ad27-dde6-4a04-a833-aa9209889391 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:50.788701 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c17ad27-dde6-4a04-a833-aa9209889391 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:50.789321 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c17ad27-dde6-4a04-a833-aa9209889391 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:50.789932 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5c17ad27-dde6-4a04-a833-aa9209889391 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:50.814745 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-d34ca915-c756-4f81-942b-5620027d5c79 req-51ba74bd-14f2-41ba-bc17-65f841072915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e11d590-d8c5-4b4a-ba5d-0a0ae203954b", "name": "network-vif-deleted", "tag": "2bb33aac-6854-44c1-9bf8-4f4c73e872c4"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:50.825887 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-d34ca915-c756-4f81-942b-5620027d5c79 req-51ba74bd-14f2-41ba-bc17-65f841072915 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:50.826497 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-d34ca915-c756-4f81-942b-5620027d5c79 req-51ba74bd-14f2-41ba-bc17-65f841072915 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:50.827069 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-d34ca915-c756-4f81-942b-5620027d5c79 req-51ba74bd-14f2-41ba-bc17-65f841072915 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:50.840445 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-d34ca915-c756-4f81-942b-5620027d5c79 req-51ba74bd-14f2-41ba-bc17-65f841072915 service nova] Creating event network-vif-deleted:2bb33aac-6854-44c1-9bf8-4f4c73e872c4 for instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b on hv-cinder-84773 Sep 08 14:10:50.845341 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-d34ca915-c756-4f81-942b-5620027d5c79 req-51ba74bd-14f2-41ba-bc17-65f841072915 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034266 Sep 08 14:10:50.845948 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 572/1142] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:50.860415 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-5c17ad27-dde6-4a04-a833-aa9209889391 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:50.868469 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5c17ad27-dde6-4a04-a833-aa9209889391 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1383 microversion: 2.1 time: 0.095062 Sep 08 14:10:50.869090 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 571/1143] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:50 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1383 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:51.892962 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:51.893673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:51.899998 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:51.900481 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:51.900934 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:51.901608 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:51.902099 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:51.902523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:51.935054 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:51.935546 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:51.935984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:51.936431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lazy-loading 'fault' on Instance uuid 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:10:51.979896 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cfda5bb8284716935e7670bf44f647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4361bb4c424b41aed6f6afa040df84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:51.988110 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3897eb74-4b12-4a93-a628-355c246c12d6 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 200 len: 1225 microversion: 2.1 time: 0.100030 Sep 08 14:10:51.992984 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 573/1144] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:51 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:52.121969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d033a717-306a-4310-a93f-e2b5cd3c8ad3 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:52.122461 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d033a717-306a-4310-a93f-e2b5cd3c8ad3 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:52.128833 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d033a717-306a-4310-a93f-e2b5cd3c8ad3 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:52.129374 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d033a717-306a-4310-a93f-e2b5cd3c8ad3 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:52.129776 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d033a717-306a-4310-a93f-e2b5cd3c8ad3 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:52.130471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d033a717-306a-4310-a93f-e2b5cd3c8ad3 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:52.130951 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d033a717-306a-4310-a93f-e2b5cd3c8ad3 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:52.131382 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d033a717-306a-4310-a93f-e2b5cd3c8ad3 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:52.213042 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-d033a717-306a-4310-a93f-e2b5cd3c8ad3 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lazy-loading 'services' on Instance uuid 1c98510c-ee3a-4107-b285-117b8425a026 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:10:52.482176 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d033a717-306a-4310-a93f-e2b5cd3c8ad3 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "DELETE /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026/os-volume_attachments/d6c4d505-a75a-4b1e-9fdd-93254746ddbf" status: 202 len: 0 microversion: 2.1 time: 0.363699 Sep 08 14:10:52.483052 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 572/1145] 10.222.0.91 () {58 vars in 1416 bytes} [Thu Sep 8 14:10:52 2022] DELETE /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026/os-volume_attachments/d6c4d505-a75a-4b1e-9fdd-93254746ddbf => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:10:53.011521 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:53.012132 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] [instance: 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:53.018991 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:53.019483 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:53.019920 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:53.020620 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:53.021590 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:53.021998 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:53.035321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] HTTP exception thrown: Instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b could not be found. Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Request method failure captured: Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b HTTP/1.1 Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfa-VFJT6-CwJXBOMzJIJg-Bgf4W9odPxFwUFo0_0uPyeu4kPxb9crMUlfF_Wxuud7z-d8_aLY68sWOuw5Vth0vqsQ3qBUNXyjDjvTPQSRW51NGQBGHSkkuEAh5eN9e21DWeOzcxPk0BsvdMzsx01-JyOgwr7WbDrDLnEc15X4rMxH4 Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 0d4361bb4c424b41aed6f6afa040df84 Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-TestShelveInstance-992601996 Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:10:53.037586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0d4361bb4c424b41aed6f6afa040df84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/0d4361bb4c424b41aed6f6afa040df84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_0d4361bb4c424b41aed6f6afa040df84", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0d4361bb4c424b41aed6f6afa040df84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-TestShelveInstance-992601996 Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 0d4361bb4c424b41aed6f6afa040df84 Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-TestShelveInstance-992601996 Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-TestShelveInstance-992601996-project Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 30cfda5bb8284716935e7670bf44f647 Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-TestShelveInstance-992601996-project Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b could not be found. Sep 08 14:10:53.039327 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '8e11d590-d8c5-4b4a-ba5d-0a0ae203954b'} Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b could not be found. Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:10:53.040406 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b could not be found. Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b could not be found. Sep 08 14:10:53.042125 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:10:53.043689 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Returning 404 to user: Instance 8e11d590-d8c5-4b4a-ba5d-0a0ae203954b could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:10:53.043689 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-ae9ceced-28fc-4d9c-9424-f292c5a8d660 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b" status: 404 len: 111 microversion: 2.1 time: 0.031427 Sep 08 14:10:53.043689 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 574/1146] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:53 2022] GET /compute/v2.1/servers/8e11d590-d8c5-4b4a-ba5d-0a0ae203954b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:10:53.309840 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9f3dc943-2a75-4b82-9548-0d3436620c44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] Calling method '.version_select at 0x7f51fbf0e670>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:53.414125 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9f3dc943-2a75-4b82-9548-0d3436620c44 tempest-TestShelveInstance-992601996 tempest-TestShelveInstance-992601996-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1027931487" status: 202 len: 0 microversion: 2.1 time: 0.109214 Sep 08 14:10:53.414708 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 573/1147] 10.222.0.91 () {58 vars in 1254 bytes} [Thu Sep 8 14:10:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1027931487 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:10:53.609955 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4ed55bc4-a707-4ba8-a996-f809c6111d21 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:53.611275 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4ed55bc4-a707-4ba8-a996-f809c6111d21 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:53.618323 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4ed55bc4-a707-4ba8-a996-f809c6111d21 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:53.618799 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4ed55bc4-a707-4ba8-a996-f809c6111d21 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:53.619262 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4ed55bc4-a707-4ba8-a996-f809c6111d21 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:53.619968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4ed55bc4-a707-4ba8-a996-f809c6111d21 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:53.620416 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4ed55bc4-a707-4ba8-a996-f809c6111d21 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:53.621105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4ed55bc4-a707-4ba8-a996-f809c6111d21 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:53.650085 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4ed55bc4-a707-4ba8-a996-f809c6111d21 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Going to try to terminate instance {{(pid=133059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:10:53.916542 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4ed55bc4-a707-4ba8-a996-f809c6111d21 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "DELETE /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 204 len: 0 microversion: 2.1 time: 0.310121 Sep 08 14:10:53.917272 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 575/1148] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:10:53 2022] DELETE /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:10:53.925556 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8f6f5131-649c-4494-b5ee-469c0a5b007b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:53.926262 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8f6f5131-649c-4494-b5ee-469c0a5b007b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:53.933712 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f6f5131-649c-4494-b5ee-469c0a5b007b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:53.934201 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f6f5131-649c-4494-b5ee-469c0a5b007b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:53.934636 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f6f5131-649c-4494-b5ee-469c0a5b007b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:53.935403 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f6f5131-649c-4494-b5ee-469c0a5b007b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:53.935839 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f6f5131-649c-4494-b5ee-469c0a5b007b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:53.936287 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8f6f5131-649c-4494-b5ee-469c0a5b007b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:54.143155 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8f6f5131-649c-4494-b5ee-469c0a5b007b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:54.151042 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8f6f5131-649c-4494-b5ee-469c0a5b007b tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1512 microversion: 2.1 time: 0.229370 Sep 08 14:10:54.151846 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 574/1149] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:53 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:55.174818 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-677ab0af-feda-4eb0-b76c-9cd205003929 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:55.175536 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-677ab0af-feda-4eb0-b76c-9cd205003929 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:55.182379 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-677ab0af-feda-4eb0-b76c-9cd205003929 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:55.182854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-677ab0af-feda-4eb0-b76c-9cd205003929 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:55.183312 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-677ab0af-feda-4eb0-b76c-9cd205003929 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:55.183992 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-677ab0af-feda-4eb0-b76c-9cd205003929 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:55.184434 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-677ab0af-feda-4eb0-b76c-9cd205003929 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:55.184845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-677ab0af-feda-4eb0-b76c-9cd205003929 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:55.317422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-677ab0af-feda-4eb0-b76c-9cd205003929 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:55.326101 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-677ab0af-feda-4eb0-b76c-9cd205003929 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1512 microversion: 2.1 time: 0.155437 Sep 08 14:10:55.327015 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 576/1150] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:55 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:56.355408 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-81ab1b20-e4f4-411f-bdaf-4c08551d67eb tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:56.356144 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-81ab1b20-e4f4-411f-bdaf-4c08551d67eb tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:56.365334 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81ab1b20-e4f4-411f-bdaf-4c08551d67eb tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:56.365925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81ab1b20-e4f4-411f-bdaf-4c08551d67eb tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:56.366427 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81ab1b20-e4f4-411f-bdaf-4c08551d67eb tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:56.367428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81ab1b20-e4f4-411f-bdaf-4c08551d67eb tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:56.367966 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81ab1b20-e4f4-411f-bdaf-4c08551d67eb tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:56.368584 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81ab1b20-e4f4-411f-bdaf-4c08551d67eb tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:56.582569 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-4e660a3c-2c7d-427d-9266-b9214da73cee req-03e121e8-692a-492b-b4f6-cfd34b1bcf90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c98510c-ee3a-4107-b285-117b8425a026", "name": "network-vif-deleted", "tag": "897dd128-96c5-409b-8c2a-d4b1f57bcd8b"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:56.586457 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-81ab1b20-e4f4-411f-bdaf-4c08551d67eb tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:56.595212 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-81ab1b20-e4f4-411f-bdaf-4c08551d67eb tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1512 microversion: 2.1 time: 0.245245 Sep 08 14:10:56.595969 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 575/1151] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:56 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:56.607586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-4e660a3c-2c7d-427d-9266-b9214da73cee req-03e121e8-692a-492b-b4f6-cfd34b1bcf90 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:56.608194 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-4e660a3c-2c7d-427d-9266-b9214da73cee req-03e121e8-692a-492b-b4f6-cfd34b1bcf90 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:56.608661 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-4e660a3c-2c7d-427d-9266-b9214da73cee req-03e121e8-692a-492b-b4f6-cfd34b1bcf90 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:56.620613 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-4e660a3c-2c7d-427d-9266-b9214da73cee req-03e121e8-692a-492b-b4f6-cfd34b1bcf90 service nova] Creating event network-vif-deleted:897dd128-96c5-409b-8c2a-d4b1f57bcd8b for instance 1c98510c-ee3a-4107-b285-117b8425a026 on hv-cinder-84773 Sep 08 14:10:56.626821 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-4e660a3c-2c7d-427d-9266-b9214da73cee req-03e121e8-692a-492b-b4f6-cfd34b1bcf90 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049643 Sep 08 14:10:56.628138 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 577/1152] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:10:57.625655 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:57.626475 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:57.633019 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:57.633569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:57.634008 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:57.634713 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:57.635209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:57.635638 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:57.668576 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:57.668987 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:57.669472 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:57.669893 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lazy-loading 'fault' on Instance uuid 1c98510c-ee3a-4107-b285-117b8425a026 {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:10:57.714302 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac5fd494df14ee1b0faf745dcc8c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736f37b101ed43369000a5ba9d93e90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:57.723419 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-aceafd49-5fba-48ce-ad33-57614cea47e6 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 200 len: 1308 microversion: 2.1 time: 0.101681 Sep 08 14:10:57.723784 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 576/1153] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:57 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:58.748352 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:58.749255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] [instance: 1c98510c-ee3a-4107-b285-117b8425a026] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:58.756975 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:58.757606 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:58.758147 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:58.759013 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:58.759568 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:58.760102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:58.775812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] HTTP exception thrown: Instance 1c98510c-ee3a-4107-b285-117b8425a026 could not be found. Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Request method failure captured: Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 HTTP/1.1 Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGfdoCYumtY7awrAdh74duL_Y3tsp3Sb0gbprfkvL08sb61B15F9IUypwmXxqWmM6J-oUCGIzWMqVLpWZWBEIuoefk0trwKgNS4H50I0LQinS-sBFG96UfeC4ndjazvFt1CDJ_9GG3ddb6kfxWNudP0sXsIQ251YaYZJHqLp-iTbX2t4 Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: 736f37b101ed43369000a5ba9d93e90f Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-VolumesSnapshotTestJSON-642307126 Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:10:58.778002 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/736f37b101ed43369000a5ba9d93e90f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/736f37b101ed43369000a5ba9d93e90f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_736f37b101ed43369000a5ba9d93e90f", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/736f37b101ed43369000a5ba9d93e90f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-VolumesSnapshotTestJSON-642307126 Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: 736f37b101ed43369000a5ba9d93e90f Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-642307126 Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-VolumesSnapshotTestJSON-642307126-project Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 4ac5fd494df14ee1b0faf745dcc8c1e3 Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-VolumesSnapshotTestJSON-642307126-project Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 1c98510c-ee3a-4107-b285-117b8425a026 could not be found. Sep 08 14:10:58.779997 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '1c98510c-ee3a-4107-b285-117b8425a026'} Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c98510c-ee3a-4107-b285-117b8425a026 could not be found. Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:10:58.780845 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c98510c-ee3a-4107-b285-117b8425a026 could not be found. Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c98510c-ee3a-4107-b285-117b8425a026 could not be found. Sep 08 14:10:58.782757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:10:58.784067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] Returning 404 to user: Instance 1c98510c-ee3a-4107-b285-117b8425a026 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:10:58.784067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f904ae86-7702-49f2-ab3b-a2f945dc5d58 tempest-VolumesSnapshotTestJSON-642307126 tempest-VolumesSnapshotTestJSON-642307126-project] 10.222.0.91 "GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026" status: 404 len: 111 microversion: 2.1 time: 0.036438 Sep 08 14:10:58.784067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 578/1154] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:58 2022] GET /compute/v2.1/servers/1c98510c-ee3a-4107-b285-117b8425a026 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:12:38.134290 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:38.135070 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:38.136180 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:12:38.136311 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Thu Sep 8 14:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 (ip 10.222.0.91) !!! Sep 08 14:12:38.141496 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-e23b2f6a-9a96-4b6c-a696-9a93683f5817 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:38.149139 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e23b2f6a-9a96-4b6c-a696-9a93683f5817 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:38.151319 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e23b2f6a-9a96-4b6c-a696-9a93683f5817 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:38.151808 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e23b2f6a-9a96-4b6c-a696-9a93683f5817 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:38.152248 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e23b2f6a-9a96-4b6c-a696-9a93683f5817 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:38.152938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e23b2f6a-9a96-4b6c-a696-9a93683f5817 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:38.153390 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e23b2f6a-9a96-4b6c-a696-9a93683f5817 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:38.153817 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-e23b2f6a-9a96-4b6c-a696-9a93683f5817 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:38.181799 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-e23b2f6a-9a96-4b6c-a696-9a93683f5817 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:12:38.513370 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-e23b2f6a-9a96-4b6c-a696-9a93683f5817 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "DELETE /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 204 len: 0 microversion: 2.1 time: 0.380508 Sep 08 14:12:38.517413 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 577/1155] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:12:38 2022] DELETE /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:12:38.521215 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:38.521987 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:38.523257 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 14:12:38.523396 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Thu Sep 8 14:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 (ip 10.222.0.91) !!! Sep 08 14:12:38.524556 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 14:12:38.524683 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Thu Sep 8 14:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 (ip 10.222.0.91) !!! Sep 08 14:12:38.528933 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5e272881-c43f-4d86-b8b4-b0313497b500 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:38.529543 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5e272881-c43f-4d86-b8b4-b0313497b500 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:38.538921 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e272881-c43f-4d86-b8b4-b0313497b500 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:38.539414 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e272881-c43f-4d86-b8b4-b0313497b500 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:38.539849 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e272881-c43f-4d86-b8b4-b0313497b500 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:38.540552 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e272881-c43f-4d86-b8b4-b0313497b500 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:38.541006 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e272881-c43f-4d86-b8b4-b0313497b500 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:38.541426 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5e272881-c43f-4d86-b8b4-b0313497b500 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:38.681992 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5e272881-c43f-4d86-b8b4-b0313497b500 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:38.689618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5e272881-c43f-4d86-b8b4-b0313497b500 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1576 microversion: 2.1 time: 0.170914 Sep 08 14:12:38.690178 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 579/1156] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:38 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:12:39.714066 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-44011797-6e5b-4395-9d13-b5d1b9615bcd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:39.714769 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-44011797-6e5b-4395-9d13-b5d1b9615bcd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:39.721871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44011797-6e5b-4395-9d13-b5d1b9615bcd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:39.722396 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44011797-6e5b-4395-9d13-b5d1b9615bcd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:39.723349 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44011797-6e5b-4395-9d13-b5d1b9615bcd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:39.724055 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44011797-6e5b-4395-9d13-b5d1b9615bcd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:39.724515 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44011797-6e5b-4395-9d13-b5d1b9615bcd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:39.724947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-44011797-6e5b-4395-9d13-b5d1b9615bcd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:39.862281 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-44011797-6e5b-4395-9d13-b5d1b9615bcd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:39.871146 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-44011797-6e5b-4395-9d13-b5d1b9615bcd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1576 microversion: 2.1 time: 0.161307 Sep 08 14:12:39.871666 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 578/1157] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:39 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:12:40.895538 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-01d82111-8c33-4c05-889c-7710c5f09052 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:40.896163 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-01d82111-8c33-4c05-889c-7710c5f09052 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:40.903688 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01d82111-8c33-4c05-889c-7710c5f09052 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:40.904184 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01d82111-8c33-4c05-889c-7710c5f09052 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:40.904679 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01d82111-8c33-4c05-889c-7710c5f09052 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:40.905738 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01d82111-8c33-4c05-889c-7710c5f09052 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:40.906079 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01d82111-8c33-4c05-889c-7710c5f09052 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:40.906522 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-01d82111-8c33-4c05-889c-7710c5f09052 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:40.973447 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-01d82111-8c33-4c05-889c-7710c5f09052 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:40.981587 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-01d82111-8c33-4c05-889c-7710c5f09052 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1508 microversion: 2.1 time: 0.091295 Sep 08 14:12:40.982161 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 580/1158] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:40 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1508 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:41.215989 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-d50ee683-aa4f-4a63-bbc5-1743fe14d5d7 req-877aa649-c08c-4899-a443-0825dc957e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f355c07f-03f5-463b-b66b-2b025743ad30", "name": "network-vif-deleted", "tag": "2ce643bd-a09a-48f1-b96a-6fac0788afc9"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:41.227760 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-d50ee683-aa4f-4a63-bbc5-1743fe14d5d7 req-877aa649-c08c-4899-a443-0825dc957e3a service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:41.232246 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-d50ee683-aa4f-4a63-bbc5-1743fe14d5d7 req-877aa649-c08c-4899-a443-0825dc957e3a service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:41.232246 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-d50ee683-aa4f-4a63-bbc5-1743fe14d5d7 req-877aa649-c08c-4899-a443-0825dc957e3a service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:41.241441 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-d50ee683-aa4f-4a63-bbc5-1743fe14d5d7 req-877aa649-c08c-4899-a443-0825dc957e3a service nova] Creating event network-vif-deleted:2ce643bd-a09a-48f1-b96a-6fac0788afc9 for instance f355c07f-03f5-463b-b66b-2b025743ad30 on hv-cinder-84773 Sep 08 14:12:41.248147 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-d50ee683-aa4f-4a63-bbc5-1743fe14d5d7 req-877aa649-c08c-4899-a443-0825dc957e3a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036435 Sep 08 14:12:41.248934 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 579/1159] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:12:42.006460 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:42.007232 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:42.014422 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:42.014929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:42.015630 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:42.016335 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:42.016790 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:42.017214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:42.050386 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:42.050943 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:42.051378 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:42.051829 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lazy-loading 'fault' on Instance uuid f355c07f-03f5-463b-b66b-2b025743ad30 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:12:42.098471 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:42.104606 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-836b69b7-a8c9-42d7-8cea-3102d6870984 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 200 len: 1230 microversion: 2.1 time: 0.102883 Sep 08 14:12:42.105449 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 581/1160] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:42 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:43.128875 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:43.129580 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:43.136022 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:43.136512 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:43.136961 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:43.137669 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:43.138127 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:43.138556 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:43.152903 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] HTTP exception thrown: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Request method failure captured: Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 HTTP/1.1 Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGferw67AHZalLAn6ADJ12qbsINhB0HH_vQCPHP9HE4FWaC39DoXRO3FqOEVsWTaurwL-WBtrLBSFmJ43-07xzI6BiO5mcS--dzsoiPIi2I3Qq3xui5GnrQIMFpj3c4Cf41fZQuBEDHil5VoJE2eQKLtUob5gjY_34WfTT0TDLOkTjLU Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: f7224a31a8aa4e7ca9514d77b5f00526 Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-TestVolumeBootPattern-851261199 Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:12:43.154545 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_f7224a31a8aa4e7ca9514d77b5f00526", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-TestVolumeBootPattern-851261199 Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: f7224a31a8aa4e7ca9514d77b5f00526 Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-TestVolumeBootPattern-851261199 Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-TestVolumeBootPattern-851261199-project Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 4b8776b82114444cbe35aa534fe14fa2 Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-TestVolumeBootPattern-851261199-project Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:12:43.156378 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'f355c07f-03f5-463b-b66b-2b025743ad30'} Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:12:43.157404 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:12:43.159132 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:12:43.161297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Returning 404 to user: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:12:43.161297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-4a55e52b-810f-4f30-b36b-42c4edfe3e78 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 404 len: 111 microversion: 2.1 time: 0.031877 Sep 08 14:12:43.161297 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 580/1161] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:43 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:12:43.253224 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1142121107", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-753369397", "security_groups": [{"name": "tempest-secgroup-smoke-1981503644"}], "block_device_mapping_v2": [{"uuid": "ddaca33b-5b83-4959-a54c-0ca5efe958d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3f20d1f7-5cf6-420f-b9b2-96be12e0ef13"}]}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:43.367737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] validate_networks() for [('3f20d1f7-5cf6-420f-b9b2-96be12e0ef13', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:12:43.845090 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:12:43.845541 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:12:43.846007 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:12:43.846409 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:12:43.846954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:12:43.855854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:43.856325 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:43.856750 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:43.857467 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:43.857913 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:43.858330 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:43.875709 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Getting quotas for project f7224a31a8aa4e7ca9514d77b5f00526. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:12:43.880326 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Getting quotas for user 4b8776b82114444cbe35aa534fe14fa2 and project f7224a31a8aa4e7ca9514d77b5f00526. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:12:43.937622 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:12:43.939895 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddaca33b-5b83-4959-a54c-0ca5efe958d8',volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:12:44.345380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-02e91482-25cd-4650-b5e2-d2bb7910a1de tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.096107 Sep 08 14:12:44.346136 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 582/1162] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:12:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:12:44.358161 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d01b5d38-67d8-4fbf-99df-189aae2733c7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:44.358764 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d01b5d38-67d8-4fbf-99df-189aae2733c7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:44.415360 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-d01b5d38-67d8-4fbf-99df-189aae2733c7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:44.422463 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d01b5d38-67d8-4fbf-99df-189aae2733c7 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1094 microversion: 2.1 time: 0.068251 Sep 08 14:12:44.423043 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 581/1163] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:44 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:45.447034 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-16687214-07d7-4623-9a26-e555ed663b65 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:45.447586 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-16687214-07d7-4623-9a26-e555ed663b65 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:45.453755 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16687214-07d7-4623-9a26-e555ed663b65 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:45.454239 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16687214-07d7-4623-9a26-e555ed663b65 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:45.454677 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16687214-07d7-4623-9a26-e555ed663b65 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:45.455402 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16687214-07d7-4623-9a26-e555ed663b65 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:45.455856 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16687214-07d7-4623-9a26-e555ed663b65 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:45.456282 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-16687214-07d7-4623-9a26-e555ed663b65 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:45.525994 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-16687214-07d7-4623-9a26-e555ed663b65 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:45.533927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-16687214-07d7-4623-9a26-e555ed663b65 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1144 microversion: 2.1 time: 0.091916 Sep 08 14:12:45.534496 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 583/1164] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:45 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:46.557726 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-ee1e3553-289d-4219-b422-ae6b76b32ce2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:46.558345 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-ee1e3553-289d-4219-b422-ae6b76b32ce2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:46.566706 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ee1e3553-289d-4219-b422-ae6b76b32ce2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:46.567283 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ee1e3553-289d-4219-b422-ae6b76b32ce2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:46.567723 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ee1e3553-289d-4219-b422-ae6b76b32ce2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:46.568424 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ee1e3553-289d-4219-b422-ae6b76b32ce2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:46.568934 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ee1e3553-289d-4219-b422-ae6b76b32ce2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:46.569944 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-ee1e3553-289d-4219-b422-ae6b76b32ce2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:46.646908 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-ee1e3553-289d-4219-b422-ae6b76b32ce2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:46.654841 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-ee1e3553-289d-4219-b422-ae6b76b32ce2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1200 microversion: 2.1 time: 0.101770 Sep 08 14:12:46.660466 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 582/1165] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:46 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1200 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:47.679635 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4d226c51-b943-4e9f-814b-a813924e5dc2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:47.680524 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4d226c51-b943-4e9f-814b-a813924e5dc2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:47.686968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d226c51-b943-4e9f-814b-a813924e5dc2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:47.687475 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d226c51-b943-4e9f-814b-a813924e5dc2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:47.687907 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d226c51-b943-4e9f-814b-a813924e5dc2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:47.688738 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d226c51-b943-4e9f-814b-a813924e5dc2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:47.689148 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d226c51-b943-4e9f-814b-a813924e5dc2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:47.689571 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4d226c51-b943-4e9f-814b-a813924e5dc2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:47.853606 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4d226c51-b943-4e9f-814b-a813924e5dc2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:47.863622 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4d226c51-b943-4e9f-814b-a813924e5dc2 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1278 microversion: 2.1 time: 0.189003 Sep 08 14:12:47.864205 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 584/1166] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:47 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:48.309168 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-607e53cc-e370-40fe-b225-181da3e6b936 req-b879ebde-48f8-489b-bda4-345324048e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36879c5c-6492-4bef-a04c-60ba75c2c35b", "tag": "a23a0275-ada4-459c-a1a8-6db0eb60b7f1"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:48.319270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-607e53cc-e370-40fe-b225-181da3e6b936 req-b879ebde-48f8-489b-bda4-345324048e74 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:48.319748 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-607e53cc-e370-40fe-b225-181da3e6b936 req-b879ebde-48f8-489b-bda4-345324048e74 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:48.320177 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-607e53cc-e370-40fe-b225-181da3e6b936 req-b879ebde-48f8-489b-bda4-345324048e74 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:48.333371 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-607e53cc-e370-40fe-b225-181da3e6b936 req-b879ebde-48f8-489b-bda4-345324048e74 service nova] Creating event network-changed:a23a0275-ada4-459c-a1a8-6db0eb60b7f1 for instance 36879c5c-6492-4bef-a04c-60ba75c2c35b on hv-cinder-84773 Sep 08 14:12:48.338592 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-607e53cc-e370-40fe-b225-181da3e6b936 req-b879ebde-48f8-489b-bda4-345324048e74 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033110 Sep 08 14:12:48.339667 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 583/1167] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:48.887438 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-f3fbd480-562a-4069-92b5-5992ac9116ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:48.888105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-f3fbd480-562a-4069-92b5-5992ac9116ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:48.895153 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f3fbd480-562a-4069-92b5-5992ac9116ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:48.895643 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f3fbd480-562a-4069-92b5-5992ac9116ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:48.896083 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f3fbd480-562a-4069-92b5-5992ac9116ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:48.897405 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f3fbd480-562a-4069-92b5-5992ac9116ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:48.897869 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f3fbd480-562a-4069-92b5-5992ac9116ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:48.898298 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-f3fbd480-562a-4069-92b5-5992ac9116ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:49.034757 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-f3fbd480-562a-4069-92b5-5992ac9116ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:49.043078 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-f3fbd480-562a-4069-92b5-5992ac9116ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1266 microversion: 2.1 time: 0.159535 Sep 08 14:12:49.043664 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 585/1168] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:48 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:50.068192 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f4c61226-ad6d-4993-a556-ea805faf34ca tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:50.068885 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f4c61226-ad6d-4993-a556-ea805faf34ca tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:50.075274 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f4c61226-ad6d-4993-a556-ea805faf34ca tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.075797 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f4c61226-ad6d-4993-a556-ea805faf34ca tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.076308 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f4c61226-ad6d-4993-a556-ea805faf34ca tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.077006 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f4c61226-ad6d-4993-a556-ea805faf34ca tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.077464 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f4c61226-ad6d-4993-a556-ea805faf34ca tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.077883 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f4c61226-ad6d-4993-a556-ea805faf34ca tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.211755 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f4c61226-ad6d-4993-a556-ea805faf34ca tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:50.219497 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f4c61226-ad6d-4993-a556-ea805faf34ca tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1266 microversion: 2.1 time: 0.156629 Sep 08 14:12:50.222461 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 584/1169] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:50 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:51.243939 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-076cebda-884d-4b8c-a6d1-31b9d1b414ae tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:51.244602 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-076cebda-884d-4b8c-a6d1-31b9d1b414ae tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:51.251356 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-076cebda-884d-4b8c-a6d1-31b9d1b414ae tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:51.251842 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-076cebda-884d-4b8c-a6d1-31b9d1b414ae tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:51.252268 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-076cebda-884d-4b8c-a6d1-31b9d1b414ae tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:51.252970 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-076cebda-884d-4b8c-a6d1-31b9d1b414ae tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:51.253410 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-076cebda-884d-4b8c-a6d1-31b9d1b414ae tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:51.253824 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-076cebda-884d-4b8c-a6d1-31b9d1b414ae tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:51.390703 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-076cebda-884d-4b8c-a6d1-31b9d1b414ae tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:51.399812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-076cebda-884d-4b8c-a6d1-31b9d1b414ae tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1266 microversion: 2.1 time: 0.159711 Sep 08 14:12:51.400398 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 586/1170] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:51 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:52.421866 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c1b4db2a-823a-44d1-a557-703a4c18f8a1 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:52.423566 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c1b4db2a-823a-44d1-a557-703a4c18f8a1 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:52.434296 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c1b4db2a-823a-44d1-a557-703a4c18f8a1 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:52.435053 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c1b4db2a-823a-44d1-a557-703a4c18f8a1 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:52.435695 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c1b4db2a-823a-44d1-a557-703a4c18f8a1 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:52.436546 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c1b4db2a-823a-44d1-a557-703a4c18f8a1 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:52.437057 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c1b4db2a-823a-44d1-a557-703a4c18f8a1 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:52.437535 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c1b4db2a-823a-44d1-a557-703a4c18f8a1 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:52.575746 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c1b4db2a-823a-44d1-a557-703a4c18f8a1 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:52.585675 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c1b4db2a-823a-44d1-a557-703a4c18f8a1 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1266 microversion: 2.1 time: 0.167674 Sep 08 14:12:52.586256 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 585/1171] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:52 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:12:53.608595 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-eff39a76-26f6-442f-a3c9-a18e5d56596d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:53.609205 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-eff39a76-26f6-442f-a3c9-a18e5d56596d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:53.615894 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eff39a76-26f6-442f-a3c9-a18e5d56596d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:53.616376 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eff39a76-26f6-442f-a3c9-a18e5d56596d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:53.616812 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eff39a76-26f6-442f-a3c9-a18e5d56596d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:53.617502 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eff39a76-26f6-442f-a3c9-a18e5d56596d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:53.617954 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eff39a76-26f6-442f-a3c9-a18e5d56596d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:53.618375 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eff39a76-26f6-442f-a3c9-a18e5d56596d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:53.749651 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-eff39a76-26f6-442f-a3c9-a18e5d56596d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:53.758013 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-eff39a76-26f6-442f-a3c9-a18e5d56596d tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1266 microversion: 2.1 time: 0.153381 Sep 08 14:12:53.758689 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 587/1172] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:53 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:54.783202 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-32dacce2-11f1-436e-830f-71a01fafcee9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:54.783758 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-32dacce2-11f1-436e-830f-71a01fafcee9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:54.786209 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:54.791005 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32dacce2-11f1-436e-830f-71a01fafcee9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:54.791495 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32dacce2-11f1-436e-830f-71a01fafcee9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:54.791923 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32dacce2-11f1-436e-830f-71a01fafcee9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:54.792605 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32dacce2-11f1-436e-830f-71a01fafcee9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:54.793051 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32dacce2-11f1-436e-830f-71a01fafcee9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:54.793471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-32dacce2-11f1-436e-830f-71a01fafcee9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:54.929906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-32dacce2-11f1-436e-830f-71a01fafcee9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:54.937725 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-32dacce2-11f1-436e-830f-71a01fafcee9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1266 microversion: 2.1 time: 0.158634 Sep 08 14:12:54.938287 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 586/1173] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:54 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:55.960357 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-cb11701c-c827-40dc-99b3-f47a17e59417 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:55.960963 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-cb11701c-c827-40dc-99b3-f47a17e59417 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:55.962822 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:55.963526 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=6 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:55.968940 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb11701c-c827-40dc-99b3-f47a17e59417 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:55.969530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb11701c-c827-40dc-99b3-f47a17e59417 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:55.970086 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb11701c-c827-40dc-99b3-f47a17e59417 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:55.970830 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb11701c-c827-40dc-99b3-f47a17e59417 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:55.971313 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb11701c-c827-40dc-99b3-f47a17e59417 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:55.971734 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-cb11701c-c827-40dc-99b3-f47a17e59417 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:56.109229 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-cb11701c-c827-40dc-99b3-f47a17e59417 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:56.117597 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-cb11701c-c827-40dc-99b3-f47a17e59417 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1266 microversion: 2.1 time: 0.161446 Sep 08 14:12:56.118170 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 588/1174] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:55 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:12:57.141058 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-cb0c6b3f-d9f6-4465-a60e-9503282d75a3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:57.141662 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-cb0c6b3f-d9f6-4465-a60e-9503282d75a3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:57.148828 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb0c6b3f-d9f6-4465-a60e-9503282d75a3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:57.149308 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb0c6b3f-d9f6-4465-a60e-9503282d75a3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:57.149787 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb0c6b3f-d9f6-4465-a60e-9503282d75a3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:57.150479 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb0c6b3f-d9f6-4465-a60e-9503282d75a3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:57.150947 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb0c6b3f-d9f6-4465-a60e-9503282d75a3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:57.151372 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-cb0c6b3f-d9f6-4465-a60e-9503282d75a3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:57.285654 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-cb0c6b3f-d9f6-4465-a60e-9503282d75a3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:57.293676 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-cb0c6b3f-d9f6-4465-a60e-9503282d75a3 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1266 microversion: 2.1 time: 0.156751 Sep 08 14:12:57.294244 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 587/1175] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:57 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:57.908229 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-9692f200-bd6a-4c61-8e52-c21b02577842 req-9990600a-ad5b-4a11-a445-d0280d3d37c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36879c5c-6492-4bef-a04c-60ba75c2c35b", "name": "network-vif-plugged", "status": "completed", "tag": "a23a0275-ada4-459c-a1a8-6db0eb60b7f1"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:57.925454 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-9692f200-bd6a-4c61-8e52-c21b02577842 req-9990600a-ad5b-4a11-a445-d0280d3d37c4 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:57.925454 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-9692f200-bd6a-4c61-8e52-c21b02577842 req-9990600a-ad5b-4a11-a445-d0280d3d37c4 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:57.925454 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-9692f200-bd6a-4c61-8e52-c21b02577842 req-9990600a-ad5b-4a11-a445-d0280d3d37c4 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:57.930863 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-9692f200-bd6a-4c61-8e52-c21b02577842 req-9990600a-ad5b-4a11-a445-d0280d3d37c4 service nova] Creating event network-vif-plugged:a23a0275-ada4-459c-a1a8-6db0eb60b7f1 for instance 36879c5c-6492-4bef-a04c-60ba75c2c35b on hv-cinder-84773 Sep 08 14:12:57.936144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-9692f200-bd6a-4c61-8e52-c21b02577842 req-9990600a-ad5b-4a11-a445-d0280d3d37c4 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153021 Sep 08 14:12:57.936787 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 589/1176] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:58.316394 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8745a0bc-8567-493d-b1d0-03c8e69bf822 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:58.317001 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8745a0bc-8567-493d-b1d0-03c8e69bf822 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:58.323680 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8745a0bc-8567-493d-b1d0-03c8e69bf822 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:58.324200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8745a0bc-8567-493d-b1d0-03c8e69bf822 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:58.324630 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8745a0bc-8567-493d-b1d0-03c8e69bf822 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:58.325325 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8745a0bc-8567-493d-b1d0-03c8e69bf822 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:58.325773 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8745a0bc-8567-493d-b1d0-03c8e69bf822 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:58.326200 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8745a0bc-8567-493d-b1d0-03c8e69bf822 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:58.491301 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8745a0bc-8567-493d-b1d0-03c8e69bf822 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:58.499471 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8745a0bc-8567-493d-b1d0-03c8e69bf822 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1266 microversion: 2.1 time: 0.187085 Sep 08 14:12:58.500045 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 588/1177] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:58 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:59.523773 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-eef314db-9943-4b13-af8e-b45ebdba9e6e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:59.525066 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-eef314db-9943-4b13-af8e-b45ebdba9e6e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:59.531214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eef314db-9943-4b13-af8e-b45ebdba9e6e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:59.531685 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eef314db-9943-4b13-af8e-b45ebdba9e6e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:59.532116 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eef314db-9943-4b13-af8e-b45ebdba9e6e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:59.532792 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eef314db-9943-4b13-af8e-b45ebdba9e6e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:59.533237 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eef314db-9943-4b13-af8e-b45ebdba9e6e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:59.533657 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-eef314db-9943-4b13-af8e-b45ebdba9e6e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:59.667737 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-eef314db-9943-4b13-af8e-b45ebdba9e6e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:59.675464 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-eef314db-9943-4b13-af8e-b45ebdba9e6e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1266 microversion: 2.1 time: 0.156421 Sep 08 14:12:59.676034 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 590/1178] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:59 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:00.698008 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-220f3813-1f71-4526-9645-865c2b016205 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:00.698618 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-220f3813-1f71-4526-9645-865c2b016205 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:00.705083 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-220f3813-1f71-4526-9645-865c2b016205 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:00.705569 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-220f3813-1f71-4526-9645-865c2b016205 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:00.706007 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-220f3813-1f71-4526-9645-865c2b016205 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:00.706704 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-220f3813-1f71-4526-9645-865c2b016205 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:00.707185 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-220f3813-1f71-4526-9645-865c2b016205 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:00.707612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-220f3813-1f71-4526-9645-865c2b016205 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:00.843373 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-220f3813-1f71-4526-9645-865c2b016205 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:00.852550 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-220f3813-1f71-4526-9645-865c2b016205 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1453 microversion: 2.1 time: 0.158378 Sep 08 14:13:00.857902 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 589/1179] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:00 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:00.875980 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4412ec1d-c87d-4153-b9df-31b79bcdbca0 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:00.876610 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4412ec1d-c87d-4153-b9df-31b79bcdbca0 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:00.883458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4412ec1d-c87d-4153-b9df-31b79bcdbca0 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:00.883953 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4412ec1d-c87d-4153-b9df-31b79bcdbca0 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:00.884393 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4412ec1d-c87d-4153-b9df-31b79bcdbca0 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:00.885105 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4412ec1d-c87d-4153-b9df-31b79bcdbca0 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:00.885559 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4412ec1d-c87d-4153-b9df-31b79bcdbca0 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:00.885986 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4412ec1d-c87d-4153-b9df-31b79bcdbca0 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:01.021685 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-4412ec1d-c87d-4153-b9df-31b79bcdbca0 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:01.030506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4412ec1d-c87d-4153-b9df-31b79bcdbca0 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1453 microversion: 2.1 time: 0.158451 Sep 08 14:13:01.031118 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 591/1180] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:00 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:03.168128 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-ff51d334-fbb0-4900-a08a-10176d71a5bb req-e6a881c1-3435-4281-a3a2-0c9871811969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36879c5c-6492-4bef-a04c-60ba75c2c35b", "tag": "a23a0275-ada4-459c-a1a8-6db0eb60b7f1"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:03.177865 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-ff51d334-fbb0-4900-a08a-10176d71a5bb req-e6a881c1-3435-4281-a3a2-0c9871811969 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:03.178348 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-ff51d334-fbb0-4900-a08a-10176d71a5bb req-e6a881c1-3435-4281-a3a2-0c9871811969 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:03.178776 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-ff51d334-fbb0-4900-a08a-10176d71a5bb req-e6a881c1-3435-4281-a3a2-0c9871811969 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:03.190341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-ff51d334-fbb0-4900-a08a-10176d71a5bb req-e6a881c1-3435-4281-a3a2-0c9871811969 service nova] Creating event network-changed:a23a0275-ada4-459c-a1a8-6db0eb60b7f1 for instance 36879c5c-6492-4bef-a04c-60ba75c2c35b on hv-cinder-84773 Sep 08 14:13:03.195614 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-ff51d334-fbb0-4900-a08a-10176d71a5bb req-e6a881c1-3435-4281-a3a2-0c9871811969 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031742 Sep 08 14:13:03.196223 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 590/1181] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:14:37.787102 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:37.789894 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=72 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:37.793321 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-77769690", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-753369397", "security_groups": [{"name": "tempest-secgroup-smoke-1981503644"}], "block_device_mapping_v2": [{"uuid": "b1434229-e14f-45f1-8d94-88b946889708", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3f20d1f7-5cf6-420f-b9b2-96be12e0ef13"}]}} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:37.909146 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.network.neutron [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] validate_networks() for [('3f20d1f7-5cf6-420f-b9b2-96be12e0ef13', None, None, None, None, None)] {{(pid=133059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:14:38.279814 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Flavor limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:14:38.280231 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Image limits 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:14:38.280697 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Flavor pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:14:38.281101 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Image pref 0:0:0 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:14:38.281504 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.virt.hardware [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:14:38.291067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:38.296240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:38.296240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:38.296240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:38.296240 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:38.296746 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:38.310867 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Getting quotas for project f7224a31a8aa4e7ca9514d77b5f00526. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:14:38.314758 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.quota [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Getting quotas for user 4b8776b82114444cbe35aa534fe14fa2 and project f7224a31a8aa4e7ca9514d77b5f00526. Resources: {'cores', 'ram', 'instances'} {{(pid=133059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:14:38.371607 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Going to run 1 instances... {{(pid=133059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:14:38.373695 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1434229-e14f-45f1-8d94-88b946889708',volume_size=None,volume_type=None)] {{(pid=133059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:14:38.804318 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-86866b61-2690-4ef1-89af-a0f6cdca120e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.018971 Sep 08 14:14:38.805040 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 592/1182] 10.222.0.91 () {60 vars in 1147 bytes} [Thu Sep 8 14:14:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:14:38.815080 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:38.816120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:38.817201 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:14:38.817362 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Thu Sep 8 14:14:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 (ip 10.222.0.91) !!! Sep 08 14:14:38.823937 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f73c8bbe-c6a1-4faa-9cb4-a17618f28189 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:38.824608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f73c8bbe-c6a1-4faa-9cb4-a17618f28189 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:38.881247 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f73c8bbe-c6a1-4faa-9cb4-a17618f28189 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:38.901608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f73c8bbe-c6a1-4faa-9cb4-a17618f28189 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1092 microversion: 2.1 time: 0.077650 Sep 08 14:14:38.901608 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 591/1183] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:38 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1092 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:14:39.914444 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-731b7627-d95e-47f5-b1dc-05385a3456ce tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:39.915070 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-731b7627-d95e-47f5-b1dc-05385a3456ce tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:39.922565 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-731b7627-d95e-47f5-b1dc-05385a3456ce tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:39.923085 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-731b7627-d95e-47f5-b1dc-05385a3456ce tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:39.923515 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-731b7627-d95e-47f5-b1dc-05385a3456ce tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:39.924203 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-731b7627-d95e-47f5-b1dc-05385a3456ce tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:39.924650 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-731b7627-d95e-47f5-b1dc-05385a3456ce tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:39.925069 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-731b7627-d95e-47f5-b1dc-05385a3456ce tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:39.987968 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-731b7627-d95e-47f5-b1dc-05385a3456ce tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:39.995765 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-731b7627-d95e-47f5-b1dc-05385a3456ce tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1134 microversion: 2.1 time: 0.085672 Sep 08 14:14:39.996337 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 593/1184] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:39 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1134 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:41.017900 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-21e804b6-c596-4839-8b01-4951dbad0acc tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:41.018428 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-21e804b6-c596-4839-8b01-4951dbad0acc tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:41.027029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-21e804b6-c596-4839-8b01-4951dbad0acc tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:41.027522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-21e804b6-c596-4839-8b01-4951dbad0acc tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:41.027959 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-21e804b6-c596-4839-8b01-4951dbad0acc tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:41.028733 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-21e804b6-c596-4839-8b01-4951dbad0acc tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:41.029109 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-21e804b6-c596-4839-8b01-4951dbad0acc tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:41.029540 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-21e804b6-c596-4839-8b01-4951dbad0acc tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:41.096322 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-21e804b6-c596-4839-8b01-4951dbad0acc tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:41.104516 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-21e804b6-c596-4839-8b01-4951dbad0acc tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1208 microversion: 2.1 time: 0.090502 Sep 08 14:14:41.105147 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 592/1185] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:41 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:42.127805 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b789734a-7137-4207-a217-520a7305dbf8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:42.128419 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b789734a-7137-4207-a217-520a7305dbf8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:42.134944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b789734a-7137-4207-a217-520a7305dbf8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:42.135429 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b789734a-7137-4207-a217-520a7305dbf8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:42.135862 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b789734a-7137-4207-a217-520a7305dbf8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:42.136844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b789734a-7137-4207-a217-520a7305dbf8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:42.137270 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b789734a-7137-4207-a217-520a7305dbf8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:42.137806 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b789734a-7137-4207-a217-520a7305dbf8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:42.281435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-b789734a-7137-4207-a217-520a7305dbf8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:42.291142 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b789734a-7137-4207-a217-520a7305dbf8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1276 microversion: 2.1 time: 0.166466 Sep 08 14:14:42.291990 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 594/1186] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:42 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:42.596067 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-bfd393f5-9867-4638-92c8-4852d6566dbf req-699f6493-33d6-411b-b905-2bc7687cd26c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d037f1-9c33-47fc-a2c2-4f6016232e25", "tag": "7f7ba891-18db-4aee-aeb7-0e604c441b79"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:42.605871 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-bfd393f5-9867-4638-92c8-4852d6566dbf req-699f6493-33d6-411b-b905-2bc7687cd26c service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:42.606341 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-bfd393f5-9867-4638-92c8-4852d6566dbf req-699f6493-33d6-411b-b905-2bc7687cd26c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:42.606775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-bfd393f5-9867-4638-92c8-4852d6566dbf req-699f6493-33d6-411b-b905-2bc7687cd26c service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:42.617913 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-bfd393f5-9867-4638-92c8-4852d6566dbf req-699f6493-33d6-411b-b905-2bc7687cd26c service nova] Creating event network-changed:7f7ba891-18db-4aee-aeb7-0e604c441b79 for instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 on hv-cinder-84773 Sep 08 14:14:42.623193 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-bfd393f5-9867-4638-92c8-4852d6566dbf req-699f6493-33d6-411b-b905-2bc7687cd26c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030698 Sep 08 14:14:42.623875 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 593/1187] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:14:43.314855 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-1a6b7c87-0ab3-4025-b869-7ab862c039ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:43.315493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-1a6b7c87-0ab3-4025-b869-7ab862c039ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:43.322377 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1a6b7c87-0ab3-4025-b869-7ab862c039ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:43.322854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1a6b7c87-0ab3-4025-b869-7ab862c039ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:43.323308 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1a6b7c87-0ab3-4025-b869-7ab862c039ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:43.323999 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1a6b7c87-0ab3-4025-b869-7ab862c039ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:43.324458 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1a6b7c87-0ab3-4025-b869-7ab862c039ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:43.324873 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-1a6b7c87-0ab3-4025-b869-7ab862c039ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:43.457245 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-1a6b7c87-0ab3-4025-b869-7ab862c039ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:43.466472 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-1a6b7c87-0ab3-4025-b869-7ab862c039ac tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.155532 Sep 08 14:14:43.467067 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 595/1188] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:43 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:44.490755 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b562613a-feca-468d-b5ac-3fe1b88f9e0a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:44.491483 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b562613a-feca-468d-b5ac-3fe1b88f9e0a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:44.498854 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b562613a-feca-468d-b5ac-3fe1b88f9e0a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:44.499447 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b562613a-feca-468d-b5ac-3fe1b88f9e0a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:44.499887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b562613a-feca-468d-b5ac-3fe1b88f9e0a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:44.500731 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b562613a-feca-468d-b5ac-3fe1b88f9e0a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:44.501368 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b562613a-feca-468d-b5ac-3fe1b88f9e0a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:44.501851 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b562613a-feca-468d-b5ac-3fe1b88f9e0a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:44.636099 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b562613a-feca-468d-b5ac-3fe1b88f9e0a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:44.644435 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b562613a-feca-468d-b5ac-3fe1b88f9e0a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.158417 Sep 08 14:14:44.645031 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 594/1189] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:44 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:45.668146 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-45f048bf-0a1d-4247-b213-7577fde18a11 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:45.668756 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-45f048bf-0a1d-4247-b213-7577fde18a11 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:45.675304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45f048bf-0a1d-4247-b213-7577fde18a11 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:45.675801 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45f048bf-0a1d-4247-b213-7577fde18a11 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:45.676214 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45f048bf-0a1d-4247-b213-7577fde18a11 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:45.676901 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45f048bf-0a1d-4247-b213-7577fde18a11 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:45.677355 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45f048bf-0a1d-4247-b213-7577fde18a11 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:45.677777 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-45f048bf-0a1d-4247-b213-7577fde18a11 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:45.812443 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-45f048bf-0a1d-4247-b213-7577fde18a11 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:45.820143 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-45f048bf-0a1d-4247-b213-7577fde18a11 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.156580 Sep 08 14:14:45.820714 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 596/1190] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:45 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:46.843233 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-c92172f7-54ee-4c5b-986e-52f8e61055a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:46.843788 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-c92172f7-54ee-4c5b-986e-52f8e61055a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:46.850184 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c92172f7-54ee-4c5b-986e-52f8e61055a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:46.850662 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c92172f7-54ee-4c5b-986e-52f8e61055a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:46.851124 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c92172f7-54ee-4c5b-986e-52f8e61055a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:46.852917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c92172f7-54ee-4c5b-986e-52f8e61055a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:46.852917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c92172f7-54ee-4c5b-986e-52f8e61055a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:46.852917 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-c92172f7-54ee-4c5b-986e-52f8e61055a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:46.990697 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-c92172f7-54ee-4c5b-986e-52f8e61055a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:46.998844 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-c92172f7-54ee-4c5b-986e-52f8e61055a4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.159658 Sep 08 14:14:46.999468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 595/1191] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:46 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:48.022096 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-3b600038-a9b4-444a-b0f5-cacf506581bb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:48.022639 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-3b600038-a9b4-444a-b0f5-cacf506581bb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:48.029186 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3b600038-a9b4-444a-b0f5-cacf506581bb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:48.029673 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3b600038-a9b4-444a-b0f5-cacf506581bb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:48.030104 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3b600038-a9b4-444a-b0f5-cacf506581bb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:48.030795 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3b600038-a9b4-444a-b0f5-cacf506581bb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:48.031283 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3b600038-a9b4-444a-b0f5-cacf506581bb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:48.031705 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-3b600038-a9b4-444a-b0f5-cacf506581bb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:48.165625 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-3b600038-a9b4-444a-b0f5-cacf506581bb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:48.173377 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-3b600038-a9b4-444a-b0f5-cacf506581bb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.155269 Sep 08 14:14:48.173936 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 597/1192] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:48 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:49.200985 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-f514ea09-896c-4008-85c6-c382337d0f50 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:49.201521 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-f514ea09-896c-4008-85c6-c382337d0f50 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:49.203963 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell0:SELECT=2 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:49.208938 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f514ea09-896c-4008-85c6-c382337d0f50 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:49.209542 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f514ea09-896c-4008-85c6-c382337d0f50 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:49.210081 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f514ea09-896c-4008-85c6-c382337d0f50 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:49.210979 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f514ea09-896c-4008-85c6-c382337d0f50 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:49.211631 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f514ea09-896c-4008-85c6-c382337d0f50 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:49.212170 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-f514ea09-896c-4008-85c6-c382337d0f50 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:49.353490 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-f514ea09-896c-4008-85c6-c382337d0f50 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:49.363270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-f514ea09-896c-4008-85c6-c382337d0f50 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.168528 Sep 08 14:14:49.364120 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 596/1193] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:49 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:50.390729 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-5424221f-7cef-47f1-af3f-cacb7f8c0168 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:50.391484 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-5424221f-7cef-47f1-af3f-cacb7f8c0168 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:50.393311 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=2 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:50.393963 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell0:SELECT=6 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:50.399482 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5424221f-7cef-47f1-af3f-cacb7f8c0168 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:50.399970 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5424221f-7cef-47f1-af3f-cacb7f8c0168 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:50.400408 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5424221f-7cef-47f1-af3f-cacb7f8c0168 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:50.401140 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5424221f-7cef-47f1-af3f-cacb7f8c0168 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:50.401596 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5424221f-7cef-47f1-af3f-cacb7f8c0168 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:50.402025 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-5424221f-7cef-47f1-af3f-cacb7f8c0168 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:50.537919 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-5424221f-7cef-47f1-af3f-cacb7f8c0168 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:50.546850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-5424221f-7cef-47f1-af3f-cacb7f8c0168 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.160316 Sep 08 14:14:50.547474 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 598/1194] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:50 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:51.569673 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-81c52bb9-6392-4108-abb8-4e86bf387c92 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:51.570277 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-81c52bb9-6392-4108-abb8-4e86bf387c92 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:51.577739 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81c52bb9-6392-4108-abb8-4e86bf387c92 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:51.578219 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81c52bb9-6392-4108-abb8-4e86bf387c92 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:51.578653 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81c52bb9-6392-4108-abb8-4e86bf387c92 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:51.579363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81c52bb9-6392-4108-abb8-4e86bf387c92 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:51.579813 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81c52bb9-6392-4108-abb8-4e86bf387c92 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:51.580232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-81c52bb9-6392-4108-abb8-4e86bf387c92 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:51.717596 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-81c52bb9-6392-4108-abb8-4e86bf387c92 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:51.725498 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-81c52bb9-6392-4108-abb8-4e86bf387c92 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.159732 Sep 08 14:14:51.726066 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 597/1195] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:51 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:52.751511 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-59626aab-a457-456c-acc4-602f6a1095b6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:52.753880 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-59626aab-a457-456c-acc4-602f6a1095b6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:52.762484 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59626aab-a457-456c-acc4-602f6a1095b6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:52.763021 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59626aab-a457-456c-acc4-602f6a1095b6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:52.763455 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59626aab-a457-456c-acc4-602f6a1095b6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:52.764171 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59626aab-a457-456c-acc4-602f6a1095b6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:52.764619 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59626aab-a457-456c-acc4-602f6a1095b6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:52.765042 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-59626aab-a457-456c-acc4-602f6a1095b6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:52.904426 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-59626aab-a457-456c-acc4-602f6a1095b6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:52.912483 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-59626aab-a457-456c-acc4-602f6a1095b6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.166750 Sep 08 14:14:52.913076 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 599/1196] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:52 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:53.934855 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-9a9ade35-4add-41d3-829b-19ad83ace2d9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:53.935575 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-9a9ade35-4add-41d3-829b-19ad83ace2d9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:53.942095 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a9ade35-4add-41d3-829b-19ad83ace2d9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:53.942574 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a9ade35-4add-41d3-829b-19ad83ace2d9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:53.943029 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a9ade35-4add-41d3-829b-19ad83ace2d9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:53.943721 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a9ade35-4add-41d3-829b-19ad83ace2d9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:53.944170 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a9ade35-4add-41d3-829b-19ad83ace2d9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:53.944588 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-9a9ade35-4add-41d3-829b-19ad83ace2d9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:54.083592 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-9a9ade35-4add-41d3-829b-19ad83ace2d9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:54.091480 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-9a9ade35-4add-41d3-829b-19ad83ace2d9 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.161268 Sep 08 14:14:54.092045 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 598/1197] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:53 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:54.252929 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-c5a8c543-6240-463e-a8ef-9586f3c56bab req-2440b2ed-1751-4c0f-930c-8e75c786e216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d037f1-9c33-47fc-a2c2-4f6016232e25", "name": "network-vif-plugged", "status": "completed", "tag": "7f7ba891-18db-4aee-aeb7-0e604c441b79"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:54.264381 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-c5a8c543-6240-463e-a8ef-9586f3c56bab req-2440b2ed-1751-4c0f-930c-8e75c786e216 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:54.264915 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-c5a8c543-6240-463e-a8ef-9586f3c56bab req-2440b2ed-1751-4c0f-930c-8e75c786e216 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:54.265290 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-c5a8c543-6240-463e-a8ef-9586f3c56bab req-2440b2ed-1751-4c0f-930c-8e75c786e216 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:54.277232 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-c5a8c543-6240-463e-a8ef-9586f3c56bab req-2440b2ed-1751-4c0f-930c-8e75c786e216 service nova] Creating event network-vif-plugged:7f7ba891-18db-4aee-aeb7-0e604c441b79 for instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 on hv-cinder-84773 Sep 08 14:14:54.282874 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-c5a8c543-6240-463e-a8ef-9586f3c56bab req-2440b2ed-1751-4c0f-930c-8e75c786e216 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033901 Sep 08 14:14:54.283552 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 600/1198] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:14:55.185121 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-a396c7dc-d639-4dfa-a0a6-c6d4a6dd295b tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:55.185732 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-a396c7dc-d639-4dfa-a0a6-c6d4a6dd295b tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:55.191966 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a396c7dc-d639-4dfa-a0a6-c6d4a6dd295b tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:55.192478 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a396c7dc-d639-4dfa-a0a6-c6d4a6dd295b tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:55.192887 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a396c7dc-d639-4dfa-a0a6-c6d4a6dd295b tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:55.193628 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a396c7dc-d639-4dfa-a0a6-c6d4a6dd295b tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:55.194060 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a396c7dc-d639-4dfa-a0a6-c6d4a6dd295b tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:55.194468 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-a396c7dc-d639-4dfa-a0a6-c6d4a6dd295b tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:55.331968 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-a396c7dc-d639-4dfa-a0a6-c6d4a6dd295b tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:55.339793 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-a396c7dc-d639-4dfa-a0a6-c6d4a6dd295b tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1264 microversion: 2.1 time: 0.219550 Sep 08 14:14:55.340363 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 599/1199] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:55 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:56.366846 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-31a94482-ed31-49f4-bb16-01a8b219bb1a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:56.367580 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-31a94482-ed31-49f4-bb16-01a8b219bb1a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:56.374782 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-31a94482-ed31-49f4-bb16-01a8b219bb1a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:56.375308 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-31a94482-ed31-49f4-bb16-01a8b219bb1a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:56.375754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-31a94482-ed31-49f4-bb16-01a8b219bb1a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:56.376432 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-31a94482-ed31-49f4-bb16-01a8b219bb1a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:56.376878 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-31a94482-ed31-49f4-bb16-01a8b219bb1a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:56.377290 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-31a94482-ed31-49f4-bb16-01a8b219bb1a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:56.530267 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-31a94482-ed31-49f4-bb16-01a8b219bb1a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:56.539959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-31a94482-ed31-49f4-bb16-01a8b219bb1a tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1450 microversion: 2.1 time: 0.179680 Sep 08 14:14:56.540623 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 601/1200] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:56 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:56.567190 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-6e5eaae5-43ec-43af-a378-c9d522baa842 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:56.567756 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-6e5eaae5-43ec-43af-a378-c9d522baa842 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:56.575698 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e5eaae5-43ec-43af-a378-c9d522baa842 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:56.576307 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e5eaae5-43ec-43af-a378-c9d522baa842 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:56.576757 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e5eaae5-43ec-43af-a378-c9d522baa842 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:56.577467 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e5eaae5-43ec-43af-a378-c9d522baa842 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:56.578093 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e5eaae5-43ec-43af-a378-c9d522baa842 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:56.578531 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-6e5eaae5-43ec-43af-a378-c9d522baa842 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:56.718231 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-6e5eaae5-43ec-43af-a378-c9d522baa842 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:56.726182 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-6e5eaae5-43ec-43af-a378-c9d522baa842 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1450 microversion: 2.1 time: 0.163211 Sep 08 14:14:56.726751 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 600/1201] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:56 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:58.861562 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-332bdce2-717a-4f43-85df-21c4c5f580bd req-8f188ed6-5bd2-4af8-9527-51eeba05ae5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d037f1-9c33-47fc-a2c2-4f6016232e25", "tag": "7f7ba891-18db-4aee-aeb7-0e604c441b79"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:58.872099 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-332bdce2-717a-4f43-85df-21c4c5f580bd req-8f188ed6-5bd2-4af8-9527-51eeba05ae5f service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:58.872577 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-332bdce2-717a-4f43-85df-21c4c5f580bd req-8f188ed6-5bd2-4af8-9527-51eeba05ae5f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:58.873071 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-332bdce2-717a-4f43-85df-21c4c5f580bd req-8f188ed6-5bd2-4af8-9527-51eeba05ae5f service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:58.885987 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-332bdce2-717a-4f43-85df-21c4c5f580bd req-8f188ed6-5bd2-4af8-9527-51eeba05ae5f service nova] Creating event network-changed:7f7ba891-18db-4aee-aeb7-0e604c441b79 for instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 on hv-cinder-84773 Sep 08 14:14:58.891529 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-332bdce2-717a-4f43-85df-21c4c5f580bd req-8f188ed6-5bd2-4af8-9527-51eeba05ae5f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033588 Sep 08 14:14:58.892185 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 602/1202] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:16:28.068115 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_api:SELECT=22 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:28.069775 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG dbcounter [-] [133058] Writing DB stats nova_cell1:SELECT=50 {{(pid=133058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:28.070874 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:16:28.071033 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Thu Sep 8 14:16:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 (ip 10.222.0.91) !!! Sep 08 14:16:28.072394 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:28.073702 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG dbcounter [-] [133059] Writing DB stats nova_cell1:SELECT=54 {{(pid=133059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:28.074851 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:16:28.075021 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Thu Sep 8 14:16:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.91) !!! Sep 08 14:16:28.075416 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-5a30ad44-4e3a-461d-b5bc-4fcb383bb548 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:28.075886 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5a30ad44-4e3a-461d-b5bc-4fcb383bb548 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:28.084823 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a30ad44-4e3a-461d-b5bc-4fcb383bb548 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:28.086275 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a30ad44-4e3a-461d-b5bc-4fcb383bb548 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:28.086715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a30ad44-4e3a-461d-b5bc-4fcb383bb548 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:28.087456 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a30ad44-4e3a-461d-b5bc-4fcb383bb548 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:28.087906 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a30ad44-4e3a-461d-b5bc-4fcb383bb548 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:28.090215 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-5a30ad44-4e3a-461d-b5bc-4fcb383bb548 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:28.117315 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-5a30ad44-4e3a-461d-b5bc-4fcb383bb548 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Going to try to terminate instance {{(pid=133058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:16:28.198961 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-b308c796-1eaf-45ed-a668-1a25a1295d64 req-00b4d87b-e11c-48d0-9449-ed48b8fd3f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d037f1-9c33-47fc-a2c2-4f6016232e25", "tag": "7f7ba891-18db-4aee-aeb7-0e604c441b79"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:16:28.209530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-b308c796-1eaf-45ed-a668-1a25a1295d64 req-00b4d87b-e11c-48d0-9449-ed48b8fd3f39 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:28.219055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-b308c796-1eaf-45ed-a668-1a25a1295d64 req-00b4d87b-e11c-48d0-9449-ed48b8fd3f39 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:28.219055 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-b308c796-1eaf-45ed-a668-1a25a1295d64 req-00b4d87b-e11c-48d0-9449-ed48b8fd3f39 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:28.221471 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-b308c796-1eaf-45ed-a668-1a25a1295d64 req-00b4d87b-e11c-48d0-9449-ed48b8fd3f39 service nova] Creating event network-changed:7f7ba891-18db-4aee-aeb7-0e604c441b79 for instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 on hv-cinder-84773 Sep 08 14:16:28.227150 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-b308c796-1eaf-45ed-a668-1a25a1295d64 req-00b4d87b-e11c-48d0-9449-ed48b8fd3f39 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157420 Sep 08 14:16:28.230435 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 603/1203] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:16:28.489115 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-5a30ad44-4e3a-461d-b5bc-4fcb383bb548 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "DELETE /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 204 len: 0 microversion: 2.1 time: 0.422499 Sep 08 14:16:28.489909 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 601/1204] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:16:28 2022] DELETE /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:16:28.499840 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e630f4b0-bdcb-4bf4-8156-526189368350 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:28.500523 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e630f4b0-bdcb-4bf4-8156-526189368350 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:28.508625 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e630f4b0-bdcb-4bf4-8156-526189368350 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:28.509115 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e630f4b0-bdcb-4bf4-8156-526189368350 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:28.509553 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e630f4b0-bdcb-4bf4-8156-526189368350 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:28.510255 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e630f4b0-bdcb-4bf4-8156-526189368350 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:28.511026 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e630f4b0-bdcb-4bf4-8156-526189368350 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:28.511445 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e630f4b0-bdcb-4bf4-8156-526189368350 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:28.732332 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e630f4b0-bdcb-4bf4-8156-526189368350 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:28.740463 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e630f4b0-bdcb-4bf4-8156-526189368350 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1575 microversion: 2.1 time: 0.245232 Sep 08 14:16:28.755074 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 604/1205] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:28 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:16:29.764715 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-86fd0c60-f3d8-45aa-adbf-3dd52e5ca643 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:29.765407 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-86fd0c60-f3d8-45aa-adbf-3dd52e5ca643 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:29.771798 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-86fd0c60-f3d8-45aa-adbf-3dd52e5ca643 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:29.772316 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-86fd0c60-f3d8-45aa-adbf-3dd52e5ca643 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:29.772736 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-86fd0c60-f3d8-45aa-adbf-3dd52e5ca643 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:29.773422 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-86fd0c60-f3d8-45aa-adbf-3dd52e5ca643 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:29.773866 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-86fd0c60-f3d8-45aa-adbf-3dd52e5ca643 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:29.774280 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-86fd0c60-f3d8-45aa-adbf-3dd52e5ca643 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:29.994713 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-86fd0c60-f3d8-45aa-adbf-3dd52e5ca643 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:30.002493 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-86fd0c60-f3d8-45aa-adbf-3dd52e5ca643 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1575 microversion: 2.1 time: 0.242210 Sep 08 14:16:30.003087 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 602/1206] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:29 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1575 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:30.796493 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [req-983fff1d-0fbc-429a-a166-56825ada8160 req-1fac3509-b0d6-4e3a-9ca7-f6bc0efc3d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d037f1-9c33-47fc-a2c2-4f6016232e25", "name": "network-vif-deleted", "tag": "7f7ba891-18db-4aee-aeb7-0e604c441b79"}]} {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:16:30.805871 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-983fff1d-0fbc-429a-a166-56825ada8160 req-1fac3509-b0d6-4e3a-9ca7-f6bc0efc3d93 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:30.806344 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-983fff1d-0fbc-429a-a166-56825ada8160 req-1fac3509-b0d6-4e3a-9ca7-f6bc0efc3d93 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:30.806771 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [req-983fff1d-0fbc-429a-a166-56825ada8160 req-1fac3509-b0d6-4e3a-9ca7-f6bc0efc3d93 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:30.820380 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.compute.server_external_events [req-983fff1d-0fbc-429a-a166-56825ada8160 req-1fac3509-b0d6-4e3a-9ca7-f6bc0efc3d93 service nova] Creating event network-vif-deleted:7f7ba891-18db-4aee-aeb7-0e604c441b79 for instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 on hv-cinder-84773 Sep 08 14:16:30.825924 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [req-983fff1d-0fbc-429a-a166-56825ada8160 req-1fac3509-b0d6-4e3a-9ca7-f6bc0efc3d93 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086489 Sep 08 14:16:30.826569 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 605/1207] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:16:31.025726 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-8144590c-9f6a-40cf-b975-c47e58ad8df8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:31.026399 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-8144590c-9f6a-40cf-b975-c47e58ad8df8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:31.033111 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8144590c-9f6a-40cf-b975-c47e58ad8df8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:31.033592 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8144590c-9f6a-40cf-b975-c47e58ad8df8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:31.034024 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8144590c-9f6a-40cf-b975-c47e58ad8df8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:31.034717 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8144590c-9f6a-40cf-b975-c47e58ad8df8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:31.035196 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8144590c-9f6a-40cf-b975-c47e58ad8df8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:31.035612 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-8144590c-9f6a-40cf-b975-c47e58ad8df8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:31.105419 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-8144590c-9f6a-40cf-b975-c47e58ad8df8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:31.113453 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-8144590c-9f6a-40cf-b975-c47e58ad8df8 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1223 microversion: 2.1 time: 0.091576 Sep 08 14:16:31.114046 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 603/1208] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:31 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:32.138798 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:32.139584 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:32.146273 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:32.146754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:32.147870 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:32.148567 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:32.149016 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:32.149432 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:32.182883 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:32.183431 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:32.183863 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:32.184310 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.objects.instance [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lazy-loading 'fault' on Instance uuid 41d037f1-9c33-47fc-a2c2-4f6016232e25 {{(pid=133059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:16:32.231511 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:32.238923 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-e25b5a4d-1bcf-4399-9c52-0105d97dcaeb tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 200 len: 1182 microversion: 2.1 time: 0.105207 Sep 08 14:16:32.246303 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 606/1209] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:32 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 1182 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:16:33.262207 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:33.262811 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 41d037f1-9c33-47fc-a2c2-4f6016232e25] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:33.269160 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:33.269644 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:33.270069 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:33.270743 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:33.271230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:33.271655 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:33.285077 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] HTTP exception thrown: Instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 could not be found. Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Request method failure captured: Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 HTTP/1.1 Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGferw67AHZalLAn6ADJ12qbsINhB0HH_vQCPHP9HE4FWaC39DoXRO3FqOEVsWTaurwL-WBtrLBSFmJ43-07xzI6BiO5mcS--dzsoiPIi2I3Qq3xui5GnrQIMFpj3c4Cf41fZQuBEDHil5VoJE2eQKLtUob5gjY_34WfTT0TDLOkTjLU Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: f7224a31a8aa4e7ca9514d77b5f00526 Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:16:33.286692 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_f7224a31a8aa4e7ca9514d77b5f00526", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: f7224a31a8aa4e7ca9514d77b5f00526 Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-TestVolumeBootPattern-851261199-project Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 4b8776b82114444cbe35aa534fe14fa2 Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-TestVolumeBootPattern-851261199-project Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 could not be found. Sep 08 14:16:33.289088 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': '41d037f1-9c33-47fc-a2c2-4f6016232e25'} Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 could not be found. Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:16:33.290230 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 could not be found. Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 could not be found. Sep 08 14:16:33.291933 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:16:33.293639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Returning 404 to user: Instance 41d037f1-9c33-47fc-a2c2-4f6016232e25 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:16:33.293639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-d51ccc62-2a0e-4a3a-a37a-fc5074dca7c4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25" status: 404 len: 111 microversion: 2.1 time: 0.030725 Sep 08 14:16:33.293639 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 604/1210] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:33 2022] GET /compute/v2.1/servers/41d037f1-9c33-47fc-a2c2-4f6016232e25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:16:36.814241 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-9d5c050e-6bb1-41d6-987f-a1c9c338e0d6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:36.814797 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9d5c050e-6bb1-41d6-987f-a1c9c338e0d6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:36.823894 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d5c050e-6bb1-41d6-987f-a1c9c338e0d6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:36.824530 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d5c050e-6bb1-41d6-987f-a1c9c338e0d6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:36.824972 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d5c050e-6bb1-41d6-987f-a1c9c338e0d6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:36.825362 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-74fae020-e5a0-4e80-a5bb-5e99d7902fce req-205ca79d-ec89-422d-9d98-35b04dff2f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36879c5c-6492-4bef-a04c-60ba75c2c35b", "tag": "a23a0275-ada4-459c-a1a8-6db0eb60b7f1"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:16:36.825854 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d5c050e-6bb1-41d6-987f-a1c9c338e0d6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:36.826179 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d5c050e-6bb1-41d6-987f-a1c9c338e0d6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:36.826603 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-9d5c050e-6bb1-41d6-987f-a1c9c338e0d6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:36.838287 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-74fae020-e5a0-4e80-a5bb-5e99d7902fce req-205ca79d-ec89-422d-9d98-35b04dff2f48 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:36.838777 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-74fae020-e5a0-4e80-a5bb-5e99d7902fce req-205ca79d-ec89-422d-9d98-35b04dff2f48 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:36.839270 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-74fae020-e5a0-4e80-a5bb-5e99d7902fce req-205ca79d-ec89-422d-9d98-35b04dff2f48 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:36.852013 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-74fae020-e5a0-4e80-a5bb-5e99d7902fce req-205ca79d-ec89-422d-9d98-35b04dff2f48 service nova] Creating event network-changed:a23a0275-ada4-459c-a1a8-6db0eb60b7f1 for instance 36879c5c-6492-4bef-a04c-60ba75c2c35b on hv-cinder-84773 Sep 08 14:16:36.857718 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-74fae020-e5a0-4e80-a5bb-5e99d7902fce req-205ca79d-ec89-422d-9d98-35b04dff2f48 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036613 Sep 08 14:16:36.858226 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-9d5c050e-6bb1-41d6-987f-a1c9c338e0d6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Going to try to terminate instance {{(pid=133059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:16:36.858624 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 605/1211] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:16:37.171210 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-9d5c050e-6bb1-41d6-987f-a1c9c338e0d6 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "DELETE /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 204 len: 0 microversion: 2.1 time: 0.360883 Sep 08 14:16:37.172298 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 607/1212] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:16:36 2022] DELETE /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:16:37.181805 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-b552583f-25c7-4b7f-b3ab-bfc907a1a2d5 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:37.182764 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-b552583f-25c7-4b7f-b3ab-bfc907a1a2d5 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:37.191646 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b552583f-25c7-4b7f-b3ab-bfc907a1a2d5 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:37.192372 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b552583f-25c7-4b7f-b3ab-bfc907a1a2d5 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:37.193016 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b552583f-25c7-4b7f-b3ab-bfc907a1a2d5 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:37.195019 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b552583f-25c7-4b7f-b3ab-bfc907a1a2d5 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:37.196153 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b552583f-25c7-4b7f-b3ab-bfc907a1a2d5 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:37.196598 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-b552583f-25c7-4b7f-b3ab-bfc907a1a2d5 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:37.339225 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-b552583f-25c7-4b7f-b3ab-bfc907a1a2d5 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:37.347278 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-b552583f-25c7-4b7f-b3ab-bfc907a1a2d5 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1578 microversion: 2.1 time: 0.170423 Sep 08 14:16:37.347849 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 606/1213] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:37 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:38.372754 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-29335964-c50f-4ce7-b529-385587013c2e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:38.373462 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-29335964-c50f-4ce7-b529-385587013c2e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:38.379944 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29335964-c50f-4ce7-b529-385587013c2e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:38.380451 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29335964-c50f-4ce7-b529-385587013c2e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:38.380958 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29335964-c50f-4ce7-b529-385587013c2e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:38.381659 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29335964-c50f-4ce7-b529-385587013c2e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:38.382111 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29335964-c50f-4ce7-b529-385587013c2e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:38.382631 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-29335964-c50f-4ce7-b529-385587013c2e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:38.521268 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-29335964-c50f-4ce7-b529-385587013c2e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:38.531336 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-29335964-c50f-4ce7-b529-385587013c2e tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1578 microversion: 2.1 time: 0.162645 Sep 08 14:16:38.531959 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 608/1214] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:38 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:39.366457 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [req-8d81e679-d6d8-486c-9804-0b802a90dd8e req-203281f8-d90d-4c7e-abed-8987e43abd17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36879c5c-6492-4bef-a04c-60ba75c2c35b", "name": "network-vif-deleted", "tag": "a23a0275-ada4-459c-a1a8-6db0eb60b7f1"}]} {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:16:39.377334 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-8d81e679-d6d8-486c-9804-0b802a90dd8e req-203281f8-d90d-4c7e-abed-8987e43abd17 service nova] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:39.377819 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-8d81e679-d6d8-486c-9804-0b802a90dd8e req-203281f8-d90d-4c7e-abed-8987e43abd17 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:39.378249 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [req-8d81e679-d6d8-486c-9804-0b802a90dd8e req-203281f8-d90d-4c7e-abed-8987e43abd17 service nova] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:39.390186 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.compute.server_external_events [req-8d81e679-d6d8-486c-9804-0b802a90dd8e req-203281f8-d90d-4c7e-abed-8987e43abd17 service nova] Creating event network-vif-deleted:a23a0275-ada4-459c-a1a8-6db0eb60b7f1 for instance 36879c5c-6492-4bef-a04c-60ba75c2c35b on hv-cinder-84773 Sep 08 14:16:39.395169 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [req-8d81e679-d6d8-486c-9804-0b802a90dd8e req-203281f8-d90d-4c7e-abed-8987e43abd17 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032974 Sep 08 14:16:39.395796 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 607/1215] 10.222.0.91 () {64 vars in 1317 bytes} [Thu Sep 8 14:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:16:39.556611 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-61bc2228-3ae1-4746-b86d-989dd1f64163 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:39.557446 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-61bc2228-3ae1-4746-b86d-989dd1f64163 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:39.564308 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-61bc2228-3ae1-4746-b86d-989dd1f64163 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:39.564795 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-61bc2228-3ae1-4746-b86d-989dd1f64163 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:39.565372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-61bc2228-3ae1-4746-b86d-989dd1f64163 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:39.565922 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-61bc2228-3ae1-4746-b86d-989dd1f64163 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:39.566375 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-61bc2228-3ae1-4746-b86d-989dd1f64163 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:39.566790 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-61bc2228-3ae1-4746-b86d-989dd1f64163 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:39.635018 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.policy [None req-61bc2228-3ae1-4746-b86d-989dd1f64163 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:39.644304 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-61bc2228-3ae1-4746-b86d-989dd1f64163 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1225 microversion: 2.1 time: 0.092419 Sep 08 14:16:39.645334 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 609/1216] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:39 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:40.668222 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:40.669153 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:40.675660 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:40.676146 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:40.676655 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:40.677578 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:40.678232 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:40.679203 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:40.712103 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:40.712487 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:40.712925 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:40.713374 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.objects.instance [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lazy-loading 'fault' on Instance uuid 36879c5c-6492-4bef-a04c-60ba75c2c35b {{(pid=133058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:16:41.009705 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.policy [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8776b82114444cbe35aa534fe14fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7224a31a8aa4e7ca9514d77b5f00526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:41.017014 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-2b19da69-f909-4885-836c-f9ac4ca2e2fd tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 200 len: 1184 microversion: 2.1 time: 0.353896 Sep 08 14:16:41.017575 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 608/1217] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:40 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 1184 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:42.040293 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:42.040927 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: 36879c5c-6492-4bef-a04c-60ba75c2c35b] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:42.047395 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:42.047877 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:42.048338 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:42.049021 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:42.049469 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:42.050016 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:42.063953 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] HTTP exception thrown: Instance 36879c5c-6492-4bef-a04c-60ba75c2c35b could not be found. Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Request method failure captured: Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b HTTP/1.1 Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGferw67AHZalLAn6ADJ12qbsINhB0HH_vQCPHP9HE4FWaC39DoXRO3FqOEVsWTaurwL-WBtrLBSFmJ43-07xzI6BiO5mcS--dzsoiPIi2I3Qq3xui5GnrQIMFpj3c4Cf41fZQuBEDHil5VoJE2eQKLtUob5gjY_34WfTT0TDLOkTjLU Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: f7224a31a8aa4e7ca9514d77b5f00526 Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:16:42.065618 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_f7224a31a8aa4e7ca9514d77b5f00526", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: f7224a31a8aa4e7ca9514d77b5f00526 Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-TestVolumeBootPattern-851261199-project Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 4b8776b82114444cbe35aa534fe14fa2 Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-TestVolumeBootPattern-851261199-project Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance 36879c5c-6492-4bef-a04c-60ba75c2c35b could not be found. Sep 08 14:16:42.067632 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': '36879c5c-6492-4bef-a04c-60ba75c2c35b'} Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36879c5c-6492-4bef-a04c-60ba75c2c35b could not be found. Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:16:42.068819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36879c5c-6492-4bef-a04c-60ba75c2c35b could not be found. Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36879c5c-6492-4bef-a04c-60ba75c2c35b could not be found. Sep 08 14:16:42.070656 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.072207 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Returning 404 to user: Instance 36879c5c-6492-4bef-a04c-60ba75c2c35b could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:16:42.072207 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-4aa755b1-f471-42af-a4dd-f9a47f52a806 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b" status: 404 len: 111 microversion: 2.1 time: 0.031105 Sep 08 14:16:42.072207 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 610/1218] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:42 2022] GET /compute/v2.1/servers/36879c5c-6492-4bef-a04c-60ba75c2c35b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:16:42.575782 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:42.576316 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.compute.api [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:42.583236 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:42.583821 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:42.584264 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:42.585096 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:42.586113 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:42.586544 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG oslo_concurrency.lockutils [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:42.600705 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.wsgi [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] HTTP exception thrown: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Request method failure captured: Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: request: DELETE /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 HTTP/1.1 Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept: application/json Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Accept-Encoding: identity Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Connection: close Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Length: 0 Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Content-Type: application/json Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Host: 10.222.0.91 Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: Openstack-System-Scope: None Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: User-Agent: python-urllib3/1.26.12 Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Auth-Token: gAAAAABjGferw67AHZalLAn6ADJ12qbsINhB0HH_vQCPHP9HE4FWaC39DoXRO3FqOEVsWTaurwL-WBtrLBSFmJ43-07xzI6BiO5mcS--dzsoiPIi2I3Qq3xui5GnrQIMFpj3c4Cf41fZQuBEDHil5VoJE2eQKLtUob5gjY_34WfTT0TDLOkTjLU Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Id: None Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Domain-Name: None Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Identity-Status: Confirmed Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Is-Admin-Project: True Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Id: default Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Domain-Name: Default Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Id: f7224a31a8aa4e7ca9514d77b5f00526 Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Project-Name: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Role: member,reader Sep 08 14:16:42.602522 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Roles: member,reader Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_f7224a31a8aa4e7ca9514d77b5f00526", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Id: f7224a31a8aa4e7ca9514d77b5f00526 Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-Tenant-Name: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User: tempest-TestVolumeBootPattern-851261199-project Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Id: default Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Domain-Name: Default Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Id: 4b8776b82114444cbe35aa534fe14fa2 Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: X-User-Name: tempest-TestVolumeBootPattern-851261199-project Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: method: > Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: exception: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:16:42.604446 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: action_args: {'id': 'f355c07f-03f5-463b-b66b-2b025743ad30'} Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:16:42.605590 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:16:42.607224 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.609347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Returning 404 to user: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. {{(pid=133058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:16:42.609347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-fd94aaad-0045-4d3b-9de1-0cbc9de26f83 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "DELETE /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 404 len: 111 microversion: 2.1 time: 0.032252 Sep 08 14:16:42.609347 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 609/1219] 10.222.0.91 () {58 vars in 1239 bytes} [Thu Sep 8 14:16:42 2022] DELETE /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:16:42.612850 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '>' {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:42.613476 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.compute.api [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] [instance: f355c07f-03f5-463b-b66b-2b025743ad30] Fetching instance by UUID {{(pid=133059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:42.619517 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:42.623844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:42.623844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:42.623844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Acquiring lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:42.623844 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:42.624417 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG oslo_concurrency.lockutils [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Lock "43ffdb1b-6a17-4540-82fa-c15e3a06dc21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:42.635819 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.wsgi [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] HTTP exception thrown: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Request method failure captured: Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: request: GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 HTTP/1.1 Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept: application/json Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Accept-Encoding: identity Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Connection: close Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Length: 0 Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Content-Type: application/json Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Host: 10.222.0.91 Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: Openstack-System-Scope: None Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: User-Agent: python-urllib3/1.26.12 Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Auth-Token: gAAAAABjGferw67AHZalLAn6ADJ12qbsINhB0HH_vQCPHP9HE4FWaC39DoXRO3FqOEVsWTaurwL-WBtrLBSFmJ43-07xzI6BiO5mcS--dzsoiPIi2I3Qq3xui5GnrQIMFpj3c4Cf41fZQuBEDHil5VoJE2eQKLtUob5gjY_34WfTT0TDLOkTjLU Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Id: None Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Domain-Name: None Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Identity-Status: Confirmed Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Is-Admin-Project: True Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Id: default Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Domain-Name: Default Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Id: f7224a31a8aa4e7ca9514d77b5f00526 Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Project-Name: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Role: member,reader Sep 08 14:16:42.637359 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Roles: member,reader Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_f7224a31a8aa4e7ca9514d77b5f00526", "adminURL": "http://10.222.0.91:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/f7224a31a8aa4e7ca9514d77b5f00526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}] Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Id: f7224a31a8aa4e7ca9514d77b5f00526 Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-Tenant-Name: tempest-TestVolumeBootPattern-851261199 Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User: tempest-TestVolumeBootPattern-851261199-project Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Id: default Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Domain-Name: Default Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Id: 4b8776b82114444cbe35aa534fe14fa2 Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: X-User-Name: tempest-TestVolumeBootPattern-851261199-project Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: method: > Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: exception: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:16:42.639372 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: action_args: {'id': 'f355c07f-03f5-463b-b66b-2b025743ad30'} Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: {{(pid=133059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:16:42.640506 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. Sep 08 14:16:42.642144 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: ERROR nova.api.openstack.wsgi Sep 08 14:16:42.643893 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: DEBUG nova.api.openstack.wsgi [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Returning 404 to user: Instance f355c07f-03f5-463b-b66b-2b025743ad30 could not be found. {{(pid=133059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:16:42.643893 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: INFO nova.api.openstack.requestlog [None req-b32fdfb4-e6bb-4036-9f0d-6b215b68aba4 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30" status: 404 len: 111 microversion: 2.1 time: 0.029839 Sep 08 14:16:42.643893 dv-cinder-847733-4-iscsi devstack@n-api.service[133059]: [pid: 133059|app: 0|req: 611/1220] 10.222.0.91 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:42 2022] GET /compute/v2.1/servers/f355c07f-03f5-463b-b66b-2b025743ad30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:16:44.136930 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: DEBUG nova.api.openstack.wsgi [None req-dc2fbff0-8744-414c-84bd-bdcd4a589598 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] Calling method '.version_select at 0x7f5200132a60>' {{(pid=133058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:44.229695 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: INFO nova.api.openstack.requestlog [None req-dc2fbff0-8744-414c-84bd-bdcd4a589598 tempest-TestVolumeBootPattern-851261199 tempest-TestVolumeBootPattern-851261199-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-753369397" status: 202 len: 0 microversion: 2.1 time: 0.097995 Sep 08 14:16:44.230285 dv-cinder-847733-4-iscsi devstack@n-api.service[133058]: [pid: 133058|app: 0|req: 610/1221] 10.222.0.91 () {58 vars in 1260 bytes} [Thu Sep 8 14:16:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-753369397 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)